00000001:02000400:3.0F:1787582548.495157:0:2964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg620-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787582569.836745:0:3187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg620-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1787582572.041049:0:3231:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 476 MB/s 00000001:01000000:3.0:1787582572.291079:0:3231:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 307 MB/s 00000001:01000000:2.0F:1787582572.544871:0:3231:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2129 MB/s 00000020:02000000:2.0:1787582573.770629:0:3280:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_80_g8672ae7 00000400:02000000:1.0:1787582575.247831:0:3295:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.120@tcp [8/256/0/180] 00008000:02000000:2.0:1787582579.094140:0:3445:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787582627.250976:0:5254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg620-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787582637.362480:0:5834:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787582637.362484:0:5834:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787582637.362602:0:5834:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e2ecb556 00000080:02000400:3.0:1787582637.362610:0:5834:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787582637.369933:0:5834:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787582637.369946:0:5834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787582637.369986:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000008b45397e) 00000020:00000080:3.0:1787582637.370005:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787582637.418844:0:5834:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787582637.419355:0:5834:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787582637.472104:0:5834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787582637.472142:0:5834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787582637.472163:0:5834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787582637.472214:0:5834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787582637.472239:0:5834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787582637.472814:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787582637.472822:0:5834:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787582637.472831:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa113d808b7537903 00000020:01000004:3.0:1787582637.472838:0:5834:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787582637.472842:0:5834:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787582637.472846:0:5834:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e2ecb556 from MGS 00000020:01000004:3.0:1787582637.472850:0:5834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787582637.472858:0:5834:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000030f591cd) 00000020:00000080:3.0:1787582637.472867:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787582637.472912:0:5834:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e2ecb556 from MGS, refs=2 00080000:01000000:3.0:1787582637.472917:0:5834:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787582637.472921:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa113d808b7537911 00000100:00100000:3.0:1787582637.473097:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787582637.473231:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787582637.473237:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787582637.478300:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787582637.478369:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787582637.479215:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787582637.479934:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787582637.479940:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787582637.480708:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787582637.480716:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787582637.481210:0:5834:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787582637.481216:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787582637.486799:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582637.486804:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582637.486807:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582637.487940:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582637.487944:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582637.487945:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582637.490689:0:5834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787582637.497558:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1787582637.740735:0:5834:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2387 MB/s 00000001:01000000:2.0:1787582637.996181:0:5834:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2901 MB/s 00000001:01000000:3.0:1787582638.250139:0:5834:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 397 MB/s 00000001:01000000:2.0:1787582638.504657:0:5834:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 403 MB/s 00080000:10000000:2.0:1787582638.547992:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1787582638.550465:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787582638.578911:0:5834:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787582638.578936:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787582638.578939:0:5834:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787582638.582841:0:5844:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787582638.582927:0:5834:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787582638.582994:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787582638.583208:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787582638.583236:0:5834:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787582638.590362:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787582638.590549:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787582638.590556:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787582638.609695:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787582638.609715:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787582638.613575:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787582638.613591:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787582638.615104:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787582638.615124:0:5834:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.120@tcp' 00000020:01000004:3.0:1787582638.615131:0:5834:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787582638.615186:0:5834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.120@tcp (typ=mgc) 00000020:00000080:3.0:1787582638.615197:0:5834:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.120@tcp (00000000fe00220c) 00000020:00000080:3.0:1787582638.615211:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787582638.615287:0:5834:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c04f6164@MGC192.168.206.120@tcp: add connection 192.168.206.120@tcp at head 00010000:00010000:3.0:1787582638.615469:0:5834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.120@tcp-0 is initialized 00000040:01000000:3.0:1787582638.615475:0:5834:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.120@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787582638.617434:0:5849:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787582638.625804:0:5851:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787582638.626544:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.120@tcp (uuid 615b3d9a-8a7c-4227-a987-f23a2209c536) 00000020:00000080:3.0:1787582638.626564:0:5834:0:(genops.c:1385:class_connect()) connect: client 615b3d9a-8a7c-4227-a987-f23a2209c536, cookie 0xa113d808b753791f 00000100:00080000:3.0:1787582638.626574:0:5834:0:(import.c:510:import_select_connection()) MGC192.168.206.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787582638.626579:0:5834:0:(import.c:624:import_select_connection()) MGC192.168.206.120@tcp: import 00000000c04f6164 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:3.0:1787582638.626622:0:5834:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000053918f2f x1874416186163328/t0(0) o250->MGC192.168.206.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787582638.626643:0:5834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 615b3d9a-8a7c-4227-a987-f23a2209c536->MGS 00000020:01000004:3.0:1787582638.626659:0:5834:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787582638.626664:0:5834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787582638.626676:0:5834:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000872b1f9) 00000020:00000080:3.0:1787582638.626688:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787582638.650824:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053918f2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:615b3d9a-8a7c-4227-a987-f23a2209c536:3310:1874416186163328:0@lo:250: 00000100:00100000:1.0:1787582638.650924:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582638.661823:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787582638.662052:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787582638.662059:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787582638.662389:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186163328 00000100:00100000:1.0:1787582638.662398:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186163328 00000100:00100000:1.0:1787582638.662441:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582638.662447:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1b22d50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1874416186163328:12345-0@lo:250: 00010000:00080000:1.0:1787582638.662471:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 615b3d9a-8a7c-4227-a987-f23a2209c536@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:1.0:1787582638.662505:0:5846:0:(genops.c:1385:class_connect()) connect: client 615b3d9a-8a7c-4227-a987-f23a2209c536, cookie 0xa113d808b753792d 00000100:00080000:1.0:1787582638.662626:0:5846:0:(import.c:65:import_set_state_nolock()) 000000005119ffac : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582638.662697:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1b22d50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+5:3310:x1874416186163328:12345-0@lo:250: Request processed in 249us (11773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582638.662703:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582638.662739:0:3310:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787582638.662747:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.120@tcp: connect to target with instance 0 00000100:00080000:1.0:1787582638.662753:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787582638.662757:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787582638.662759:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000c04f6164 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787582638.662762:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787582638.662768:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787582638.662772:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053918f2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:615b3d9a-8a7c-4227-a987-f23a2209c536:3310:1874416186163328:0@lo:250: 00000100:00100000:3.0:1787582638.674357:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787582638.674371:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787582638.688561:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787582638.688572:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787582638.697066:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787582638.697237:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787582638.697243:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787582638.713905:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787582638.713918:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787582638.777055:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787582638.777237:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787582638.777243:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787582638.783903:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787582638.784078:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787582638.784904:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787582638.785191:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787582638.785196:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787582638.785856:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787582638.785864:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787582638.787718:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787582638.787893:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787582638.787900:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787582638.789671:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787582638.789682:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787582638.796201:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787582638.796793:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787582638.796800:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787582638.797768:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787582638.797782:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787582638.828425:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787582638.828794:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787582638.828801:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787582638.830521:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787582638.830532:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787582638.832171:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787582638.832182:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787582638.836753:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787582638.836795:0:5834:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787582638.836801:0:5834:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787582638.836924:0:5834:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.120@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787582638.836975:0:5834:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.120@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787582638.836979:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787582638.836981:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787582638.836982:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582638.836983:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582638.836984:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582638.836985:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582638.836986:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787582638.836987:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787582638.836988:0:5834:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787582638.836990:0:5834:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787582638.836991:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582638.836993:0:5834:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787582638.836995:0:5834:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787582638.836997:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787582638.836998:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787582638.836999:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582638.837000:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582638.837001:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582638.837002:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582638.837003:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787582638.837004:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787582638.837005:0:5834:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787582638.837006:0:5834:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787582638.837007:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582638.837008:0:5834:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787582638.837032:0:5834:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787582638.837048:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186163456:0@lo:253: 00000100:00100000:3.0:1787582638.837253:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582638.837352:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000001993fae2 going to sleep for 11 seconds 00000100:00100000:1.0:1787582638.838370:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186163456 00000100:00100000:1.0:1787582638.838379:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186163456 00000100:00100000:1.0:1787582638.838438:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582638.838446:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095cde7df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+5:5834:x1874416186163456:12345-0@lo:253: 20000000:01000000:1.0:1787582638.838488:0:5848:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787582638.838491:0:5848:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787582638.838968:0:5869:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787582638.839031:0:5848:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787582638.839472:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787582638.842012:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787582638.842415:0:5848:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787582638.842420:0:5848:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787582638.842426:0:5848:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787582638.842428:0:5848:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787582638.842445:0:5848:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787582638.842760:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787582638.843563:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787582638.843578:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787582638.843629:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787582638.843680:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787582638.843718:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787582638.844253:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787582638.844264:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787582638.844457:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787582638.844467:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787582638.844503:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787582638.844510:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787582638.844541:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787582638.844589:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787582638.844627:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787582638.844632:0:5848:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787582638.844646:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787582638.845092:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787582638.845276:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787582638.845520:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787582638.845562:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787582638.845640:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787582638.845653:0:5848:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787582638.845740:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787582638.845749:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787582638.845812:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787582638.845850:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787582638.845883:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787582638.845894:0:5848:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787582638.845987:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787582638.845997:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787582638.846027:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787582638.846053:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787582638.847184:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787582638.847249:0:5848:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787582638.847256:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787582638.855089:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787582638.855520:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787582638.855543:0:5848:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.120@tcp for mdt 20000000:01000000:2.0:1787582638.855545:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.120@tcp (null) (null) (null) 00000040:00080000:2.0:1787582638.855577:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787582638.855584:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787582638.855613:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787582638.855621:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.120@tcp (null) (null) 00000040:00080000:2.0:1787582638.855665:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787582638.855674:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787582638.855701:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787582638.855731:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787582638.855799:0:5848:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787582638.855802:0:5848:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787582638.855806:0:5848:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787582638.855815:0:5848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787582638.855818:0:5848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787582638.855861:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787582638.855863:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787582638.858674:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787582638.865151:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787582638.865204:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787582638.865313:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1787582638.865914:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787582638.865917:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787582638.866659:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787582638.866968:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787582638.867036:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787582638.867125:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787582638.867140:0:5848:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787582638.867143:0:5848:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787582638.867147:0:5848:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787582638.867149:0:5848:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787582638.867154:0:5848:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787582638.867160:0:5848:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787582638.867813:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787582638.867924:0:5848:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787582638.884890:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1787582638.884962:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1787582638.885045:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1787582638.885065:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787582638.885085:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000002633f24/0xa113d808b7537934 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582638.885113:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000002633f24/0xa113d808b7537934 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582638.885122:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000002633f24/0xa113d808b7537934 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582638.885128:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000002633f24/0xa113d808b7537934 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582638.885133:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000002633f24/0xa113d808b7537934 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582638.885157:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000002633f24/0xa113d808b7537934 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582638.885163:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000002633f24 already unused, calling callback (0000000043411f1f) 00010000:00010000:2.0:1787582638.885167:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000002633f24/0xa113d808b7537934 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582638.885175:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000002633f24/0xa113d808b7537934 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582638.885187:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000002633f24/0xa113d808b7537934 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582638.885194:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000002633f24/0xa113d808b7537934 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582638.885200:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000002633f24/0xa113d808b7537934 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787582638.885220:0:5848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787582639.187446:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095cde7df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+5:5834:x1874416186163456:12345-0@lo:253: Request processed in 348995us (350187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582639.187459:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787582639.187562:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186163456:0@lo:253: 10000000:01000000:3.0:1787582639.187641:0:5834:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787582639.187645:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787582639.187647:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787582639.187648:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582639.187649:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787582639.187651:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582639.187652:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582639.187653:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787582639.187655:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787582639.187656:0:5834:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787582639.187658:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582639.187659:0:5834:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787582639.187676:0:5834:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e2ecb556 from lustre-MDT0000 10000000:01000000:3.0:1787582639.187700:0:5834:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787582639.187703:0:5834:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787582639.187706:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8da588590000 10000000:01000000:3.0:1787582639.187710:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787582639.187717:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8da588590000 from 1 10000000:01000000:3.0:1787582639.187720:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787582639.187752:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: 000000007bb710cd/0xa113d808b753793b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582639.187761:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: 000000007bb710cd/0xa113d808b753793b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582639.187768:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: 000000007bb710cd/0xa113d808b753793b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582639.187890:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186163584:0@lo:101: 00000100:00100000:3.0:1787582639.187922:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582639.188054:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087890023 going to sleep for 11 seconds 00000100:00100000:1.0:1787582639.188153:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186163584 00000100:00100000:1.0:1787582639.188165:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186163584 00000100:00100000:1.0:1787582639.188237:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787582639.188245:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025e91eaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+5:5834:x1874416186163584:12345-0@lo:101: 00010000:00010000:1.0:1787582639.188257:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582639.188280:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009000b74f/0xa113d808b7537942 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b753793b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.188313:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009000b74f/0xa113d808b7537942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b753793b expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.188343:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009000b74f/0xa113d808b7537942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b753793b expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.188350:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009000b74f, rc 0) 00000100:00100000:1.0:1787582639.188429:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025e91eaf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+6:5834:x1874416186163584:12345-0@lo:101: Request processed in 185us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582639.188436:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787582639.188563:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186163584:0@lo:101: 00010000:00010000:3.0:1787582639.188583:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: 000000007bb710cd/0xa113d808b753793b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537942 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582639.188592:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: 000000007bb710cd/0xa113d808b753793b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537942 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582639.188635:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186163712:0@lo:501: 00000100:00100000:3.0:1787582639.188660:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582639.188684:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087890023 going to sleep for 11 seconds 00000100:00100000:2.0:1787582639.188947:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186163712 00000100:00100000:2.0:1787582639.188952:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186163712 00000100:00100000:2.0:1787582639.188994:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787582639.189001:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029f80790 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+6:5834:x1874416186163712:12345-0@lo:501: 00000100:00100000:2.0:1787582639.189212:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029f80790 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+6:5834:x1874416186163712:12345-0@lo:501: Request processed in 211us (551us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787582639.189220:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787582639.189404:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186163712:0@lo:501: 10000000:01000000:3.0:1787582639.189429:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787582639.189447:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: 000000007bb710cd/0xa113d808b753793b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537942 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582639.189456:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: 000000007bb710cd/0xa113d808b753793b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537942 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582639.189464:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8da584c3b800 10000000:01000000:3.0:1787582639.189469:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787582639.189472:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8da584c3b800 10000000:01000000:3.0:1787582639.189475:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787582639.189478:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8da584c3b800 from 1 10000000:01000000:3.0:1787582639.189485:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787582639.189504:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: 00000000ad708fbd/0xa113d808b7537949 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582639.189511:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: 00000000ad708fbd/0xa113d808b7537949 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582639.189518:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: 00000000ad708fbd/0xa113d808b7537949 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582639.189529:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186163840:0@lo:101: 00000100:00100000:3.0:1787582639.189553:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582639.189614:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087890023 going to sleep for 11 seconds 00000100:00100000:1.0:1787582639.189786:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186163840 00000100:00100000:1.0:1787582639.189791:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186163840 00000100:00100000:1.0:1787582639.189812:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787582639.189818:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000709e230b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+6:5834:x1874416186163840:12345-0@lo:101: 00010000:00010000:1.0:1787582639.189825:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582639.189834:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000071d5bc8e/0xa113d808b7537950 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537949 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.189848:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071d5bc8e/0xa113d808b7537950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537949 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.189856:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000071d5bc8e/0xa113d808b7537950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537949 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.189874:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000071d5bc8e, rc 0) 00000100:00100000:1.0:1787582639.189911:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000709e230b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+7:5834:x1874416186163840:12345-0@lo:101: Request processed in 93us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582639.189916:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787582639.190205:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186163840:0@lo:101: 00010000:00010000:3.0:1787582639.190217:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: 00000000ad708fbd/0xa113d808b7537949 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537950 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582639.190224:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: 00000000ad708fbd/0xa113d808b7537949 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537950 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582639.190236:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787582639.190249:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: 00000000ad708fbd/0xa113d808b7537949 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537950 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582639.190255:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: 00000000ad708fbd/0xa113d808b7537949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537950 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582639.190261:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787582639.190265:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787582639.190268:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8da584c3b800 10000000:01000000:3.0:1787582639.190277:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787582639.190280:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787582639.190282:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787582639.190309:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: 00000000e080ccaf/0xa113d808b7537957 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582639.190342:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: 00000000e080ccaf/0xa113d808b7537957 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582639.190349:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: 00000000e080ccaf/0xa113d808b7537957 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582639.190361:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186163968:0@lo:101: 00000100:00100000:3.0:1787582639.190387:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582639.190405:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087890023 going to sleep for 11 seconds 00000100:00100000:1.0:1787582639.190444:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186163968 00000100:00100000:1.0:1787582639.190452:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186163968 00000100:00100000:1.0:1787582639.190515:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787582639.190522:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070d0e8a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+7:5834:x1874416186163968:12345-0@lo:101: 00010000:00010000:1.0:1787582639.190529:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582639.190536:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000afcdadb1/0xa113d808b753795e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537957 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.190548:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000afcdadb1/0xa113d808b753795e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537957 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.190554:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000afcdadb1/0xa113d808b753795e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537957 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.190560:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000afcdadb1, rc 0) 00000100:00100000:1.0:1787582639.190603:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070d0e8a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+8:5834:x1874416186163968:12345-0@lo:101: Request processed in 82us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582639.190609:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787582639.190668:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186163968:0@lo:101: 00010000:00010000:3.0:1787582639.190677:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: 00000000e080ccaf/0xa113d808b7537957 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b753795e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582639.190683:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: 00000000e080ccaf/0xa113d808b7537957 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b753795e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582639.190724:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186164096:0@lo:501: 00000100:00100000:3.0:1787582639.190746:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582639.190960:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087890023 going to sleep for 11 seconds 00000100:00100000:0.0:1787582639.191048:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186164096 00000100:00100000:0.0:1787582639.191053:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186164096 00000100:00100000:0.0:1787582639.191082:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787582639.191088:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095e598dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+8:5834:x1874416186164096:12345-0@lo:501: 00000100:00100000:0.0:1787582639.191344:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095e598dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+9:5834:x1874416186164096:12345-0@lo:501: Request processed in 256us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582639.191351:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787582639.191476:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186164096:0@lo:501: 00000100:00100000:3.0:1787582639.191502:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186164224:0@lo:503: 00000100:00100000:3.0:1787582639.191536:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582639.191568:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087890023 going to sleep for 11 seconds 00000100:00100000:0.0:1787582639.191676:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186164224 00000100:00100000:0.0:1787582639.191680:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186164224 00000100:00100000:0.0:1787582639.191697:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787582639.191703:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085790444 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+9:5834:x1874416186164224:12345-0@lo:503: 00000100:00100000:0.0:1787582639.191855:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085790444 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+9:5834:x1874416186164224:12345-0@lo:503: Request processed in 152us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582639.191861:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787582639.192076:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186164224:0@lo:503: 00000100:00100000:3.0:1787582639.192545:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:5877:1874416186164352:0@lo:502: 00000100:00100000:3.0:1787582639.192594:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582639.192620:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set 000000002354278c going to sleep for 11 seconds 00000100:00100000:0.0:1787582639.192723:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186164352 00000100:00100000:0.0:1787582639.192728:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186164352 00000100:00100000:0.0:1787582639.192748:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787582639.192754:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084710fb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+9:5877:x1874416186164352:12345-0@lo:502: 00000100:00100000:0.0:1787582639.192923:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084710fb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+9:5877:x1874416186164352:12345-0@lo:502: Request processed in 169us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582639.192930:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787582639.193078:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:5877:1874416186164352:0@lo:502: 00000020:01000000:3.0:1787582639.193100:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582639.193111:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582639.193114:0:5877:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787582639.193118:0:5877:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787582639.193121:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787582639.193138:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f7dad9dd) 00000020:00000080:3.0:1787582639.193154:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787582639.193159:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787582639.193225:0:5877:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787582639.193231:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa113d808b753796c 00000020:00000080:3.0:1787582639.193487:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787582639.193491:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582639.193494:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582639.193496:0:5877:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787582639.193498:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582639.193501:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582639.193503:0:5877:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787582639.193506:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787582639.193511:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a8117e50) 00000020:00000080:3.0:1787582639.193520:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787582639.193523:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787582639.193524:0:5877:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787582639.193527:0:5877:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787582639.193532:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787582639.193585:0:5877:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e2ecb556 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787582639.193602:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000003cbc4144) 00000020:00000080:3.0:1787582639.193610:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787582639.193671:0:5877:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787582639.193676:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa113d808b7537981 00000020:00000080:3.0:1787582639.193763:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787582639.193769:0:5877:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787582639.193773:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa113d808b7537988 00080000:01000000:3.0:1787582639.193777:0:5877:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787582639.193781:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa113d808b753798f 00080000:10000000:3.0:1787582639.195179:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1787582639.196253:0:5877:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787582639.204814:0:5877:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787582639.357307:0:5877:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787582639.357620:0:5877:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787582639.360495:0:5877:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787582639.360786:0:5877:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787582639.422787:0:5877:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000007fa5457f) 00000020:00000080:0.0:1787582639.422814:0:5877:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787582639.422912:0:5877:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787582639.422918:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa113d808b753799d 00000020:00000080:1.0:1787582639.425188:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787582639.430611:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787582639.477802:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787582639.503369:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787582639.530719:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787582639.563194:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:2.0:1787582639.569482:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1787582639.591948:0:5877:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1787582639.624734:0:5877:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa113d808b75379a4 00000020:00000080:2.0:1787582639.625211:0:5877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787582639.625221:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582639.625228:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582639.625230:0:5877:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787582639.625232:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582639.625236:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582639.625237:0:5877:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787582639.625240:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787582639.625241:0:5877:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787582639.625243:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582639.625245:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582639.625247:0:5877:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787582639.625249:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582639.625252:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582639.625254:0:5877:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787582639.625257:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787582639.625306:0:5877:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787582639.625381:0:5877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4437d58 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:5877:1874416186164480:0@lo:502: 00000100:00100000:2.0:1787582639.625451:0:5877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582639.625497:0:5877:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e5b4af4c going to sleep for 11 seconds 00000100:00100000:1.0:1787582639.625770:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186164480 00000100:00100000:1.0:1787582639.625777:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186164480 00000100:00100000:1.0:1787582639.625810:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787582639.625816:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000239fb7f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+9:5877:x1874416186164480:12345-0@lo:502: 00000100:00100000:1.0:1787582639.626159:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000239fb7f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+9:5877:x1874416186164480:12345-0@lo:502: Request processed in 343us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582639.626166:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787582639.626211:0:5877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4437d58 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:5877:1874416186164480:0@lo:502: 00000020:01000000:1.0:1787582639.626233:0:5877:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582639.626238:0:5877:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582639.626239:0:5877:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1787582639.626243:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787582639.626636:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787582639.626655:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787582639.626673:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: 00000000e080ccaf/0xa113d808b7537957 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b753795e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582639.626683:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: 00000000e080ccaf/0xa113d808b7537957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b753795e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582639.626690:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8da584c3b800 from 1 10000000:01000000:0.0:1787582639.626693:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787582639.626728:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: 00000000245d4d91/0xa113d808b75379ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582639.626735:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: 00000000245d4d91/0xa113d808b75379ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582639.626743:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: 00000000245d4d91/0xa113d808b75379ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582639.626756:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016fa0dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186164608:0@lo:101: 00000100:00100000:0.0:1787582639.626920:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582639.626987:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4812f67 going to sleep for 11 seconds 00000100:00100000:2.0:1787582639.627068:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186164608 00000100:00100000:2.0:1787582639.627073:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186164608 00000100:00100000:2.0:1787582639.627128:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787582639.627135:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088518469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+9:5834:x1874416186164608:12345-0@lo:101: 00010000:00010000:2.0:1787582639.627144:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582639.627155:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000002633f24/0xa113d808b75379b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b75379ab expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582639.627172:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000002633f24/0xa113d808b75379b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b75379ab expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582639.627191:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000002633f24/0xa113d808b75379b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b75379ab expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582639.627199:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000002633f24, rc 0) 00000100:00100000:2.0:1787582639.627234:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088518469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+10:5834:x1874416186164608:12345-0@lo:101: Request processed in 100us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582639.627239:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787582639.627312:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016fa0dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186164608:0@lo:101: 00010000:00010000:0.0:1787582639.627336:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: 00000000245d4d91/0xa113d808b75379ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b75379b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582639.627349:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: 00000000245d4d91/0xa113d808b75379ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b75379b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582639.627843:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016fa0dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186164736:0@lo:256: 00000100:00100000:0.0:1787582639.627877:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582639.631506:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e4812f67 going to sleep for 11 seconds 00000100:00100000:1.0:1787582639.631980:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186164736 00000100:00100000:1.0:1787582639.631990:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186164736 00000100:00100000:3.0:1787582639.632219:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787582639.632228:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa70dec1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+10:5834:x1874416186164736:12345-0@lo:256: 20000000:01000000:3.0:1787582639.632249:0:5846:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787582639.632254:0:5846:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787582639.632577:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa70dec1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+10:5834:x1874416186164736:12345-0@lo:256: Request processed in 350us (4699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582639.632585:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787582639.632648:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016fa0dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186164736:0@lo:256: 10000000:01000000:1.0:1787582639.633199:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787582639.633220:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: 00000000245d4d91/0xa113d808b75379ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b75379b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.633230:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: 00000000245d4d91/0xa113d808b75379ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b75379b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582639.633238:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da584c3b800 from 1 10000000:01000000:1.0:1787582639.633241:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787582639.633307:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: 00000000ee36f396/0xa113d808b75379b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.633314:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: 00000000ee36f396/0xa113d808b75379b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.633356:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: 00000000ee36f396/0xa113d808b75379b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582639.633371:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000355f066d pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186164864:0@lo:101: 00000100:00100000:1.0:1787582639.633407:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582639.633735:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b581bf4f going to sleep for 11 seconds 00000100:00100000:2.0:1787582639.633831:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186164864 00000100:00100000:2.0:1787582639.633838:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186164864 00000100:00100000:2.0:1787582639.633869:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787582639.633876:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed897bd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+10:5834:x1874416186164864:12345-0@lo:101: 00010000:00010000:2.0:1787582639.633887:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582639.633899:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000012302236/0xa113d808b75379c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b75379b9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582639.633919:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012302236/0xa113d808b75379c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b75379b9 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582639.633927:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000012302236/0xa113d808b75379c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b75379b9 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582639.633935:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000012302236, rc 0) 00000100:00100000:2.0:1787582639.633978:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed897bd4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+11:5834:x1874416186164864:12345-0@lo:101: Request processed in 103us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582639.633984:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787582639.634061:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000355f066d pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186164864:0@lo:101: 00010000:00010000:1.0:1787582639.634073:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: 00000000ee36f396/0xa113d808b75379b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b75379c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.634081:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: 00000000ee36f396/0xa113d808b75379b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b75379c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582639.634122:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000355f066d pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186164992:0@lo:501: 00000100:00100000:1.0:1787582639.634145:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582639.634162:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b581bf4f going to sleep for 11 seconds 00000100:00100000:3.0:1787582639.634187:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186164992 00000100:00100000:3.0:1787582639.634191:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186164992 00000100:00100000:3.0:1787582639.634208:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787582639.634213:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dbf7ff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+11:5834:x1874416186164992:12345-0@lo:501: 00000100:00100000:3.0:1787582639.634944:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dbf7ff2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+11:5834:x1874416186164992:12345-0@lo:501: Request processed in 728us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582639.634952:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787582639.635166:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000355f066d pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186164992:0@lo:501: 00000100:00100000:1.0:1787582639.635197:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000355f066d pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186165120:0@lo:503: 00000100:00100000:1.0:1787582639.635235:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582639.635262:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b581bf4f going to sleep for 11 seconds 00000100:00100000:3.0:1787582639.635429:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186165120 00000100:00100000:3.0:1787582639.635434:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186165120 00000100:00100000:3.0:1787582639.635543:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787582639.635552:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033271f63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+11:5834:x1874416186165120:12345-0@lo:503: 00000040:00080000:3.0:1787582639.635588:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787582639.635620:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033271f63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+11:5834:x1874416186165120:12345-0@lo:503: Request processed in 71us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582639.635627:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787582639.636641:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000355f066d pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186165120:0@lo:503: 00000040:00080000:1.0:1787582639.637869:0:5881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787582639.638073:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787582639.638105:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787582639.638149:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: 00000000ee36f396/0xa113d808b75379b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b75379c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582639.638159:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: 00000000ee36f396/0xa113d808b75379b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b75379c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582639.638197:0:5834:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787582639.638200:0:5834:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8da584c3b800 10000000:01000000:2.0:1787582639.638202:0:5834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8da584c3b800 10000000:01000000:2.0:1787582639.638206:0:5834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787582639.638210:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8da584c3b800 from 1 10000000:01000000:2.0:1787582639.638213:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787582639.638242:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: 0000000046d622ff/0xa113d808b75379c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582639.638250:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: 0000000046d622ff/0xa113d808b75379c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582639.638259:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: 0000000046d622ff/0xa113d808b75379c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582639.638462:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bfdfa6df pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186165248:0@lo:101: 00000100:00100000:2.0:1787582639.638518:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582639.638559:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000003fd56a84 going to sleep for 11 seconds 00000100:00100000:1.0:1787582639.638615:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186165248 00000100:00100000:1.0:1787582639.638622:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186165248 00000100:00100000:1.0:1787582639.638664:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787582639.638672:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b48d2b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+11:5834:x1874416186165248:12345-0@lo:101: 00010000:00010000:1.0:1787582639.638683:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582639.638701:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000040f679d2/0xa113d808b75379ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b75379c7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.638721:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000040f679d2/0xa113d808b75379ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b75379c7 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.638730:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000040f679d2/0xa113d808b75379ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b75379c7 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.638739:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000040f679d2, rc 0) 00000100:00100000:1.0:1787582639.638786:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b48d2b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5834:x1874416186165248:12345-0@lo:101: Request processed in 115us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582639.638793:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787582639.638941:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bfdfa6df pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186165248:0@lo:101: 00010000:00010000:2.0:1787582639.638953:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: 0000000046d622ff/0xa113d808b75379c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b75379ce expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582639.638961:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: 0000000046d622ff/0xa113d808b75379c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b75379ce expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582639.639006:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bfdfa6df pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186165376:0@lo:501: 00000100:00100000:2.0:1787582639.639027:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582639.639047:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000003fd56a84 going to sleep for 11 seconds 00000100:00100000:3.0:1787582639.639090:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186165376 00000100:00100000:3.0:1787582639.639094:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186165376 00000100:00100000:3.0:1787582639.639120:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787582639.639126:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004093198a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5834:x1874416186165376:12345-0@lo:501: 00000100:00100000:3.0:1787582639.639380:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004093198a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5834:x1874416186165376:12345-0@lo:501: Request processed in 254us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582639.639387:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787582639.639510:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bfdfa6df pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186165376:0@lo:501: 00000100:00100000:2.0:1787582639.639535:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bfdfa6df pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186165504:0@lo:503: 00000100:00100000:2.0:1787582639.639570:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582639.639594:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000003fd56a84 going to sleep for 11 seconds 00000100:00100000:1.0:1787582639.639653:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186165504 00000100:00100000:1.0:1787582639.639658:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186165504 00000100:00100000:1.0:1787582639.639683:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787582639.639688:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008035018d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5834:x1874416186165504:12345-0@lo:503: 00000100:00100000:1.0:1787582639.639884:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008035018d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5834:x1874416186165504:12345-0@lo:503: Request processed in 195us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582639.639890:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787582639.641505:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bfdfa6df pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186165504:0@lo:503: 00000100:00100000:1.0:1787582639.641935:0:5882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd1ecbd8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:5882:1874416186165632:0@lo:502: 00000100:00100000:1.0:1787582639.641986:0:5882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582639.642022:0:5882:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d8febf02 going to sleep for 11 seconds 00000100:00100000:2.0:1787582639.642060:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186165632 00000100:00100000:2.0:1787582639.642066:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186165632 00000100:00100000:2.0:1787582639.642102:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787582639.642108:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072942229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5882:x1874416186165632:12345-0@lo:502: 00000100:00100000:3.0:1787582639.644587:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072942229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5882:x1874416186165632:12345-0@lo:502: Request processed in 2474us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582639.644601:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787582639.644707:0:5882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd1ecbd8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:5882:1874416186165632:0@lo:502: 00000020:01000004:2.0:1787582639.644855:0:5882:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787582639.644879:0:5882:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000ef784cf3) 00000020:00000080:2.0:1787582639.644895:0:5882:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787582639.644973:0:5882:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e2ecb556 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787582639.644977:0:5882:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e2ecb556 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787582639.644979:0:5882:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e2ecb556 4 00010000:00080000:2.0:1787582639.645003:0:5882:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a87744f4@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.120@tcp at head 00010000:00010000:2.0:1787582639.648499:0:5882:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787582639.648727:0:5882:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787582639.648830:0:5882:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787582639.648843:0:5882:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa113d808b75379dc 00000100:00080000:2.0:1787582639.648851:0:5882:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787582639.648863:0:5882:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a87744f4 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:2.0:1787582639.648890:0:5882:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bfdfa6df x1874416186165760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787582639.648913:0:5882:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787582639.649029:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bfdfa6df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874416186165760:0@lo:38: 00000100:00100000:1.0:1787582639.649091:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582639.649355:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186165760 00000100:00100000:2.0:1787582639.649362:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186165760 00000100:00100000:2.0:1787582639.649388:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787582639.649394:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc52eb89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874416186165760:12345-0@lo:38: 00000100:00100000:2.0:1787582639.649441:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc52eb89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874416186165760:12345-0@lo:38: Request processed in 46us (350us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787582639.649447:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582639.653559:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787582639.653571:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000a87744f4 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787582639.653578:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787582639.653594:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bfdfa6df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874416186165760:0@lo:38: 00000100:00100000:3.0:1787582639.657449:0:5882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:5882:1874416186165888:0@lo:502: 00000100:00100000:3.0:1787582639.657542:0:5882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582639.657588:0:5882:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bf3e2522 going to sleep for 11 seconds 00000100:00100000:0.0:1787582639.658049:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186165888 00000100:00100000:0.0:1787582639.658057:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186165888 00000100:00100000:0.0:1787582639.658103:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787582639.658111:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5f10f60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5882:x1874416186165888:12345-0@lo:502: 00000100:00100000:0.0:1787582639.658452:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5f10f60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5882:x1874416186165888:12345-0@lo:502: Request processed in 341us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582639.658464:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787582639.658618:0:5882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d22ce2ff pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:5882:1874416186165888:0@lo:502: 00000040:00080000:1.0:1787582639.658649:0:5882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1787582639.658770:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1787582639.658791:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787582639.658811:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: 0000000046d622ff/0xa113d808b75379c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b75379ce expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582639.658821:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: 0000000046d622ff/0xa113d808b75379c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b75379ce expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787582639.658877:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787582639.658879:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787582639.658881:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582639.658892:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582639.658894:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582639.658895:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582639.658896:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787582639.659006:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787582639.659009:0:5834:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787582639.659010:0:5834:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787582639.659011:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582639.659012:0:5834:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787582639.659015:0:5834:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1787582639.659018:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787582639.659019:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787582639.659020:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582639.659021:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582639.659022:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582639.659023:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582639.659024:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787582639.659025:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787582639.659026:0:5834:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787582639.659027:0:5834:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787582639.659028:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582639.659029:0:5834:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787582639.659120:0:5834:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787582639.659134:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c97d20c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186166016:0@lo:253: 00000100:00100000:3.0:1787582639.659174:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582639.659209:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079e1585e going to sleep for 11 seconds 00000100:00100000:1.0:1787582639.659726:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186166016 00000100:00100000:1.0:1787582639.659733:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186166016 00000100:00100000:1.0:1787582639.659856:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787582639.659947:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a3884dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5834:x1874416186166016:12345-0@lo:253: 20000000:01000000:1.0:1787582639.659971:0:5848:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787582639.659982:0:5848:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787582639.698618:0:5848:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787582639.698648:0:5848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787582639.698748:0:5869:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787582639.698753:0:5869:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787582639.698784:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000094ff0e7b/0xa113d808b75379e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582639.698802:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000002633f24/0xa113d808b75379b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b75379ab expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582639.698809:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000094ff0e7b/0xa113d808b75379e3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582639.698843:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000002633f24/0xa113d808b75379b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b75379ab expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582639.698858:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000002633f24/0xa113d808b75379b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b75379ab expref: 12 pid: 5848 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582639.698883:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c0486f9c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5869:1874416186166144:0@lo:104: 00000100:00100000:0.0:1787582639.699049:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582639.699224:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set 000000005765dbb1 going to sleep for 11 seconds 00000100:00100000:2.0:1787582639.699370:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186166144 00000100:00100000:2.0:1787582639.699378:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186166144 00000100:00100000:1.0:1787582639.702811:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582639.702827:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023b7d7d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5869:x1874416186166144:12345-0@lo:104: 00010000:00010000:1.0:1787582639.702844:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: 00000000245d4d91/0xa113d808b75379ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b75379b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.702938:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787582639.702943:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023b7d7d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5869:x1874416186166144:12345-0@lo:104: Request processed in 122us (3896us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582639.702950:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787582639.702972:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582639.702976:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: 00000000245d4d91/0xa113d808b75379ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b75379b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.702983:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000245d4d91 already unused, calling callback (0000000052b2bf58) 10000000:00010000:1.0:1787582639.702986:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: 00000000245d4d91/0xa113d808b75379ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b75379b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.702993:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: 00000000245d4d91/0xa113d808b75379ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b75379b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582639.703017:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: 00000000245d4d91/0xa113d808b75379ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b75379b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582639.703022:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582639.703055:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: 00000000245d4d91/0xa113d808b75379ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b75379b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.703063:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582639.703080:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: 00000000245d4d91/0xa113d808b75379ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b75379b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.703086:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: 00000000245d4d91/0xa113d808b75379ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b75379b2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.703103:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582639.703104:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582639.703106:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582639.703163:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f5e3111 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186166272:0@lo:103: 00000100:00100000:1.0:1787582639.703197:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582639.703270:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186166272 00000100:00100000:1.0:1787582639.703277:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186166272 00010000:00010000:1.0:1787582639.703311:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000002633f24/0xa113d808b75379b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b75379ab expref: 13 pid: 5848 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582639.703429:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582639.703437:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005dc60925 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+13:3312:x1874416186166272:12345-0@lo:103: 00010000:00010000:1.0:1787582639.703448:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582639.703452:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000002633f24/0xa113d808b75379b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b75379ab expref: 13 pid: 5848 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.703467:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000002633f24/0xa113d808b75379b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b75379ab expref: 13 pid: 5848 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.703484:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000094ff0e7b/0xa113d808b75379e3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.703602:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000094ff0e7b/0xa113d808b75379e3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787582639.703645:0:5838:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004892834s 00010000:00010000:1.0:1787582639.703649:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000094ff0e7b/0xa113d808b75379e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.703655:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000094ff0e7b/0xa113d808b75379e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.703660:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000094ff0e7b/0xa113d808b75379e3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.703666:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000094ff0e7b/0xa113d808b75379e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.703671:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000094ff0e7b already unused, calling callback (0000000043411f1f) 00010000:00010000:1.0:1787582639.703674:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000094ff0e7b/0xa113d808b75379e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.703679:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000094ff0e7b/0xa113d808b75379e3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.703687:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000094ff0e7b/0xa113d808b75379e3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.703708:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582639.703749:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005dc60925 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+13:3312:x1874416186166272:12345-0@lo:103: Request processed in 314us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582639.703756:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787582639.703966:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f5e3111 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186166272:0@lo:103: 00010000:00010000:1.0:1787582639.704014:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000002633f24/0xa113d808b75379b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b75379ab expref: 12 pid: 5848 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582639.704026:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c0486f9c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5869:1874416186166144:0@lo:104: 00010000:00010000:1.0:1787582639.704039:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000094ff0e7b/0xa113d808b75379e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.704047:0:5869:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000094ff0e7b/0xa113d808b75379e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.704052:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000094ff0e7b/0xa113d808b75379e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582639.704057:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000094ff0e7b/0xa113d808b75379e3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582639.722052:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a3884dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+11:5834:x1874416186166016:12345-0@lo:253: Request processed in 62103us (62871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582639.722067:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787582639.722160:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c97d20c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:5834:1874416186166016:0@lo:253: 10000000:01000000:3.0:1787582639.722174:0:5834:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787582639.722188:0:5834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787582639.722190:0:5834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787582639.722191:0:5834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582639.722192:0:5834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582639.722194:0:5834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582639.722195:0:5834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582639.722196:0:5834:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787582639.722197:0:5834:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787582639.722199:0:5834:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787582639.722200:0:5834:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787582639.722201:0:5834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582639.722202:0:5834:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787582639.722213:0:5834:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787582639.731431:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787582639.733031:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787582639.733286:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787582639.733639:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787582639.734139:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787582639.734359:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787582639.735448:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787582639.735706:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787582639.735991:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787582639.736167:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787582639.736611:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787582639.737012:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787582639.774275:0:5834:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000020:00080000:3.0:1787582639.835734:0:5887:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787582639.835741:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787582639.835782:0:5834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787582639.836596:0:5888:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787582639.858661:0:5834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787582639.859719:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787582639.860682:0:5834:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787582639.860696:0:5834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787582639.860890:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787582639.861954:0:5834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787582639.862647:0:5834:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787582639.862676:0:5834:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787582639.862929:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787582639.863100:0:5834:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787582639.864669:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787582639.864817:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787582639.864959:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787582639.865183:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787582639.865348:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787582639.865515:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787582639.865648:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787582639.865801:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787582639.865957:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787582639.866189:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787582639.866371:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787582639.866530:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787582639.866672:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787582639.866842:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787582639.866990:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787582639.867348:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787582639.867646:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787582639.867800:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787582639.867946:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787582639.868343:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787582639.868487:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787582639.868656:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787582639.868794:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787582639.868945:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787582639.869095:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787582639.869363:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787582639.869518:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787582639.869707:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787582639.869846:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787582639.869993:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787582639.870193:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787582639.870405:0:5834:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787582639.870611:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1787582639.886408:0:5888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787582639.950795:0:5834:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787582639.950844:0:5834:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9ec641bd7988 00100000:10000000:1.0:1787582639.950851:0:5834:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787582639.952592:0:5834:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787582639.952608:0:5834:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.120@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787582639.952620:0:5834:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787582639.952636:0:5834:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787582639.955509:0:5888:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787582639.955585:0:5888:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787582639.955591:0:5888:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787582640.596553:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582641.616628:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582642.647788:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582643.669986:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787582643.775939:0:6131:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg620-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787582644.688418:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787582644.818754:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787582644.818762:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787582644.818765:0:38:0:(import.c:65:import_set_state_nolock()) 00000000a87744f4 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787582644.818777:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000a87744f4 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:1.0:1787582644.818797:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000035870ee6 x1874416186166528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787582644.818834:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035870ee6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874416186166528:0@lo:38: 00000100:00100000:1.0:1787582644.818893:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582644.819062:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787582644.819071:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000401d819a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186166400:0@lo:400: 00000100:00100000:3.0:1787582644.819100:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582644.819455:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186166528 00000100:00100000:0.0:1787582644.819464:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186166528 00000100:00100000:0.0:1787582644.819494:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787582644.819500:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba5b22fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874416186166528:12345-0@lo:38: 00010000:00080000:0.0:1787582644.819520:0:5855:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:0.0:1787582644.819550:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa113d808b75379ea 00000004:00100000:0.0:1787582644.819586:0:5855:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787582644.819716:0:5855:0:(import.c:65:import_set_state_nolock()) 0000000005b3d6c8 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787582644.819765:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba5b22fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874416186166528:12345-0@lo:38: Request processed in 264us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582644.819772:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787582644.819814:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000035870ee6 x1874416186166528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787582654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787582644.819828:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787582644.819834:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787582644.819838:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787582644.819840:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000a87744f4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787582644.819844:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035870ee6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874416186166528:0@lo:38: 00000100:00100000:1.0:1787582644.819906:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186166400 00000100:00100000:1.0:1787582644.819911:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186166400 00000100:00100000:1.0:1787582644.819941:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787582644.819947:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a9fe570 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+11:3314:x1874416186166400:12345-0@lo:400: 00000100:00100000:1.0:1787582644.819989:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a9fe570 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+11:3314:x1874416186166400:12345-0@lo:400: Request processed in 43us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582644.819995:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787582644.820165:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000401d819a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186166400:0@lo:400: 00010000:00010000:2.0:1787582645.714394:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582646.736483:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582647.760676:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787582648.401384:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787582648.401391:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8da584c3b800 from 3 10000000:01000000:1.0:1787582648.401395:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787582648.401433:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: 000000001a63f646/0xa113d808b75379f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582648.401445:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: 000000001a63f646/0xa113d808b75379f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582648.401454:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: 000000001a63f646/0xa113d808b75379f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582648.401474:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041cea37a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186166656:0@lo:101: 00000100:00100000:1.0:1787582648.401549:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582648.401655:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186166656 00000100:00100000:1.0:1787582648.401658:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ef2397e going to sleep for 11 seconds 00000100:00100000:3.0:1787582648.401664:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186166656 00000100:00100000:3.0:1787582648.401781:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787582648.401791:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e768334b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+11:5851:x1874416186166656:12345-0@lo:101: 00010000:00010000:3.0:1787582648.401813:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582648.401841:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000784d5c68/0xa113d808b75379f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b75379f1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582648.401884:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000784d5c68/0xa113d808b75379f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b75379f1 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582648.401895:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000784d5c68/0xa113d808b75379f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b75379f1 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582648.401911:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000784d5c68, rc 0) 00000100:00100000:3.0:1787582648.401951:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e768334b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5851:x1874416186166656:12345-0@lo:101: Request processed in 162us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582648.401958:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787582648.405808:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041cea37a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186166656:0@lo:101: 00010000:00010000:0.0:1787582648.405842:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: 000000001a63f646/0xa113d808b75379f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b75379f8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582648.405855:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: 000000001a63f646/0xa113d808b75379f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b75379f8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582648.412844:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004c9f63a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186166784:0@lo:256: 00000100:00100000:1.0:1787582648.412943:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582648.412999:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set 000000009ef2397e going to sleep for 11 seconds 00000100:00100000:0.0:1787582648.413087:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186166784 00000100:00100000:0.0:1787582648.413095:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186166784 00000100:00100000:0.0:1787582648.413145:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787582648.413153:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3850d12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5851:x1874416186166784:12345-0@lo:256: 20000000:01000000:0.0:1787582648.413174:0:5846:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787582648.413196:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787582648.413200:0:5846:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1787582648.413305:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3850d12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5851:x1874416186166784:12345-0@lo:256: Request processed in 152us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582648.413350:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787582648.413462:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004c9f63a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186166784:0@lo:256: 10000000:01000000:1.0:1787582648.413509:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787582648.413517:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: 000000001a63f646/0xa113d808b75379f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b75379f8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582648.413527:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: 000000001a63f646/0xa113d808b75379f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b75379f8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582648.785419:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787582649.052867:0:6332:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd1cf8db0 20000000:00000080:3.0:1787582649.052883:0:6332:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8da5b6062400 uarg=0000000000000000 20000000:01000000:3.0:1787582649.052917:0:6332:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787582649.052923:0:6332:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787582649.052927:0:6332:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787582649.053101:0:6332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787582649.053112:0:6332:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787582649.057894:0:6332:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787582649.058144:0:6332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787582649.058193:0:6332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787582649.058645:0:6332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787582649.058662:0:6332:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787582649.058685:0:6332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009554fde6/0xa113d808b75379ff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582649.058702:0:6332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000012302236/0xa113d808b75379c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b75379b9 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582649.058709:0:6332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009554fde6/0xa113d808b75379ff lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582649.058748:0:6332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000012302236/0xa113d808b75379c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b75379b9 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582649.058763:0:6332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000012302236/0xa113d808b75379c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b75379b9 expref: 11 pid: 5848 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582649.058776:0:6332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c97d20c1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6332:1874416186166912:0@lo:104: 00000100:00100000:3.0:1787582649.058842:0:6332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582649.058888:0:6332:0:(client.c:2715:ptlrpc_set_wait()) set 00000000047fded2 going to sleep for 11 seconds 00000100:00100000:2.0:1787582649.059868:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186166912 00000100:00100000:2.0:1787582649.059878:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186166912 00000100:00100000:2.0:1787582649.059934:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787582649.059942:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009971ca58 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:6332:x1874416186166912:12345-0@lo:104: 00010000:00010000:2.0:1787582649.059954:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: 00000000ee36f396/0xa113d808b75379b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b75379c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582649.060011:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787582649.060016:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009971ca58 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:6332:x1874416186166912:12345-0@lo:104: Request processed in 75us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582649.060022:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787582649.060042:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582649.060046:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: 00000000ee36f396/0xa113d808b75379b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b75379c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582649.060053:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ee36f396 already unused, calling callback (0000000052b2bf58) 10000000:00010000:2.0:1787582649.060056:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: 00000000ee36f396/0xa113d808b75379b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b75379c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582649.060063:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: 00000000ee36f396/0xa113d808b75379b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b75379c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582649.060078:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: 00000000ee36f396/0xa113d808b75379b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b75379c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582649.060084:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787582649.060112:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: 00000000ee36f396/0xa113d808b75379b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b75379c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582649.060119:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582649.060134:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: 00000000ee36f396/0xa113d808b75379b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b75379c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582649.060141:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: 00000000ee36f396/0xa113d808b75379b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b75379c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582649.060158:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582649.060159:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582649.060161:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582649.060172:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a4649d94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186167040:0@lo:103: 00000100:00100000:2.0:1787582649.060199:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582649.060797:0:6332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c97d20c1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6332:1874416186166912:0@lo:104: 00010000:00010000:3.0:1787582649.060815:0:6332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009554fde6/0xa113d808b75379ff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582649.063838:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186167040 00000100:00100000:1.0:1787582649.063850:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186167040 00010000:00010000:1.0:1787582649.063887:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000012302236/0xa113d808b75379c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b75379b9 expref: 12 pid: 5848 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582649.063964:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582649.063973:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043002ca8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+12:3314:x1874416186167040:12345-0@lo:103: 00010000:00010000:1.0:1787582649.063985:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582649.063990:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000012302236/0xa113d808b75379c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b75379b9 expref: 12 pid: 5848 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582649.064001:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000012302236/0xa113d808b75379c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b75379b9 expref: 12 pid: 5848 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582649.064015:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000012302236/0xa113d808b75379c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b75379b9 expref: 12 pid: 5848 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582649.064039:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009554fde6/0xa113d808b75379ff lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582649.064047:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009554fde6/0xa113d808b75379ff lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582649.064061:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009554fde6/0xa113d808b75379ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582649.064068:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009554fde6/0xa113d808b75379ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582649.064074:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009554fde6/0xa113d808b75379ff lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582649.064080:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009554fde6/0xa113d808b75379ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582649.064086:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009554fde6 already unused, calling callback (0000000043411f1f) 00010000:00010000:1.0:1787582649.064090:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009554fde6/0xa113d808b75379ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582649.064097:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009554fde6/0xa113d808b75379ff lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582649.064120:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009554fde6/0xa113d808b75379ff lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582649.064131:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582649.064191:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043002ca8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+11:3314:x1874416186167040:12345-0@lo:103: Request processed in 220us (3991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582649.064206:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787582649.064288:0:6332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009554fde6/0xa113d808b75379ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582649.064296:0:6332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009554fde6/0xa113d808b75379ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582649.064302:0:6332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009554fde6/0xa113d808b75379ff lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582649.069026:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a4649d94 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186167040:0@lo:103: 00010000:00010000:2.0:1787582649.808456:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582649.940922:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009fcad8eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186167168:0@lo:400: 00000100:00100000:2.0:1787582649.940986:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582649.941057:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186167168 00000100:00100000:0.0:1787582649.941065:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186167168 00000100:00100000:0.0:1787582649.941119:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787582649.941127:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017b757b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186167168:12345-0@lo:400: 00000100:00100000:0.0:1787582649.941190:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017b757b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186167168:12345-0@lo:400: Request processed in 64us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582649.941196:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787582649.941334:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009fcad8eb x1874416186167168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582649.941350:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009fcad8eb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186167168:0@lo:400: 00010000:00010000:2.0:1787582650.832599:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582651.856493:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582652.882768:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582653.908300:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582654.930694:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582655.056765:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036153488 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186167296:0@lo:400: 00000100:00100000:0.0:1787582655.056765:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005ffb83bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186167424:0@lo:400: 00000100:00100000:2.0:1787582655.063600:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.063871:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582655.064166:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186167296 00000100:00100000:3.0:1787582655.064175:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186167296 00000100:00100000:3.0:1787582655.064236:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787582655.064245:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030fb8537 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+11:3312:x1874416186167296:12345-0@lo:400: 00000100:00100000:3.0:1787582655.064314:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030fb8537 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+11:3312:x1874416186167296:12345-0@lo:400: Request processed in 70us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582655.064342:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787582655.064379:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186167424 00000100:00100000:3.0:1787582655.064394:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186167424 00000100:00100000:3.0:1787582655.064423:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787582655.064428:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007029b00d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186167424:12345-0@lo:400: 00000100:00100000:3.0:1787582655.064475:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007029b00d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186167424:12345-0@lo:400: Request processed in 48us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582655.064481:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787582655.064513:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005ffb83bb x1874416186167424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582655.064527:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005ffb83bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186167424:0@lo:400: 00000100:00100000:2.0:1787582655.065017:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036153488 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186167296:0@lo:400: 00000020:01000004:3.0:1787582655.078353:0:6700:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787582655.078357:0:6700:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787582655.078594:0:6700:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000004c513418 00000020:01000004:2.0:1787582655.078611:0:6700:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787582655.078622:0:6700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787582655.078634:0:6700:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000af3ddb20) 00000020:00000080:2.0:1787582655.078647:0:6700:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787582655.106510:0:6700:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787582655.106731:0:6700:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787582655.128022:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1787582655.132728:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787582655.132761:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1787582655.132811:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787582655.132834:0:6700:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1787582655.133128:0:6700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787582655.133138:0:6700:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787582655.133147:0:6700:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa113d808b7537a0d 00000020:01000004:1.0:1787582655.133153:0:6700:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787582655.133171:0:6700:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.120@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787582655.133174:0:6700:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787582655.133256:0:6700:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787582655.133261:0:6700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787582655.133278:0:6700:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000002d07a3bd) 00000020:00000080:1.0:1787582655.133290:0:6700:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1787582655.138397:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787582655.138602:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787582655.138609:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1787582655.146707:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1787582655.146719:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787582655.147080:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787582655.147086:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787582655.148974:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787582655.149158:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787582655.149165:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787582655.150504:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787582655.150514:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787582655.177147:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787582655.177511:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787582655.177518:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787582655.180932:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787582655.180945:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787582655.188938:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787582655.188956:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787582655.195544:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787582655.195734:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787582655.195739:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787582655.199310:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787582655.199346:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787582655.248640:0:6700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787582655.248913:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787582655.248920:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787582655.249996:0:6700:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787582655.250007:0:6700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787582655.250613:0:6700:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787582655.250638:0:6700:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787582655.250644:0:6700:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787582655.277828:0:6700:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.120@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787582655.277858:0:6700:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.120@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787582655.277861:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787582655.277863:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787582655.277867:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787582655.277868:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787582655.277869:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787582655.277870:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787582655.277872:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787582655.277873:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787582655.277874:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787582655.277876:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787582655.277877:0:6700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787582655.277880:0:6700:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787582655.277883:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787582655.277884:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787582655.277885:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787582655.277886:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787582655.277887:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787582655.277888:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787582655.277889:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787582655.277889:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787582655.277890:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787582655.277891:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787582655.277892:0:6700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787582655.277914:0:6700:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787582655.277927:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000067608e75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186167552:0@lo:253: 00000100:00100000:0.0:1787582655.277986:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.278086:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b141a55f going to sleep for 11 seconds 00000100:00100000:1.0:1787582655.281861:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186167552 00000100:00100000:1.0:1787582655.281888:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186167552 00000100:00100000:1.0:1787582655.281979:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787582655.281987:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbdd2e56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+11:6700:x1874416186167552:12345-0@lo:253: 20000000:01000000:1.0:1787582655.282039:0:5847:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787582655.282044:0:5847:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787582655.282049:0:5847:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787582655.282052:0:5847:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787582655.283169:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787582655.283736:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787582655.283752:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787582655.283793:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787582655.283801:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787582655.283847:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787582655.283895:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787582655.284882:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787582655.284906:0:5847:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.120@tcp 20000000:01000000:1.0:1787582655.284907:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.120@tcp (null) (null) (null) 00000040:00080000:1.0:1787582655.284941:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787582655.284949:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787582655.285006:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787582655.285015:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.120@tcp (null) (null) 00000040:00080000:1.0:1787582655.285140:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787582655.285151:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787582655.285543:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787582655.285613:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787582655.286725:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787582655.286746:0:5847:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.120@tcp 20000000:01000000:2.0:1787582655.286748:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.120@tcp (null) (null) (null) 00000040:00080000:2.0:1787582655.286777:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787582655.286783:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787582655.286807:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787582655.286813:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.120@tcp (null) (null) 00000040:00080000:2.0:1787582655.286849:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787582655.286857:0:5847:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787582655.286882:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1787582655.286910:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1787582655.286924:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787582655.286927:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787582655.286931:0:5847:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787582655.286949:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787582655.286951:0:5847:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787582655.286981:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787582655.286983:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787582655.287759:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787582655.292842:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787582655.292887:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787582655.292947:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787582655.292959:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787582655.292961:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787582655.293862:0:6716:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1787582655.293937:0:6716:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1787582655.294000:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787582655.294557:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787582655.294590:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787582655.294639:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787582655.294651:0:5847:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787582655.294653:0:5847:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787582655.295100:0:6717:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787582655.295164:0:6717:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787582655.295300:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787582655.295591:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787582655.295632:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787582655.295666:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1787582655.295680:0:5847:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787582655.295683:0:5847:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787582655.295691:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787582655.295707:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.295724:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009000b74f/0xa113d808b7537942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b753793b expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.295732:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000afcdadb1/0xa113d808b753795e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537957 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.295738:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000040f679d2/0xa113d808b75379ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b75379c7 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.295744:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.295784:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000040f679d2/0xa113d808b75379ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b75379c7 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.295796:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000040f679d2/0xa113d808b75379ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b75379c7 expref: 11 pid: 5848 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582655.295809:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c00a46d7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5847:1874416186167680:0@lo:104: 00000100:00100000:2.0:1787582655.295860:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582655.295955:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000afcdadb1/0xa113d808b753795e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537957 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.295963:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000afcdadb1/0xa113d808b753795e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537957 expref: 11 pid: 5847 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582655.295970:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6e22297 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5847:1874416186167808:0@lo:104: 00000100:00100000:2.0:1787582655.295988:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582655.296066:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009000b74f/0xa113d808b7537942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b753793b expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.296073:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009000b74f/0xa113d808b7537942 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b753793b expref: 11 pid: 5847 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582655.296081:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000623b2ec7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5847:1874416186167936:0@lo:104: 00000100:00100000:2.0:1787582655.296100:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.296264:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186167680 00000100:00100000:1.0:1787582655.296271:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186167680 00000100:00100000:1.0:1787582655.296301:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186167808 00000100:00100000:1.0:1787582655.296303:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186167808 00000100:00100000:1.0:1787582655.296314:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787582655.296349:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022ad3f83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+4:5847:x1874416186167680:12345-0@lo:104: 00010000:00010000:1.0:1787582655.296360:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: 0000000046d622ff/0xa113d808b75379c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b75379ce expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.296417:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787582655.296422:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022ad3f83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+4:5847:x1874416186167680:12345-0@lo:104: Request processed in 75us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.296430:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787582655.296446:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787582655.296452:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079e6fdb9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5847:x1874416186167808:12345-0@lo:104: 00010000:00010000:1.0:1787582655.296458:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: 00000000e080ccaf/0xa113d808b7537957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b753795e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.296486:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787582655.296490:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079e6fdb9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5847:x1874416186167808:12345-0@lo:104: Request processed in 40us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.296495:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787582655.296510:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787582655.296514:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: 0000000046d622ff/0xa113d808b75379c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b75379ce expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.296521:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046d622ff already unused, calling callback (0000000052b2bf58) 10000000:00010000:1.0:1787582655.296523:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: 0000000046d622ff/0xa113d808b75379c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b75379ce expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.296530:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: 0000000046d622ff/0xa113d808b75379c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b75379ce expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582655.296537:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: 0000000046d622ff/0xa113d808b75379c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b75379ce expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582655.296542:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582655.296575:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: 0000000046d622ff/0xa113d808b75379c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b75379ce expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.296582:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582655.296598:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: 0000000046d622ff/0xa113d808b75379c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b75379ce expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.296604:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: 0000000046d622ff/0xa113d808b75379c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b75379ce expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.296616:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582655.296618:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: 00000000e080ccaf/0xa113d808b7537957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b753795e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.296623:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e080ccaf already unused, calling callback (0000000052b2bf58) 10000000:00010000:1.0:1787582655.296625:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: 00000000e080ccaf/0xa113d808b7537957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b753795e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.296631:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: 00000000e080ccaf/0xa113d808b7537957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b753795e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582655.296636:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: 00000000e080ccaf/0xa113d808b7537957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b753795e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582655.296641:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582655.296652:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: 00000000e080ccaf/0xa113d808b7537957 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b753795e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.296658:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582655.296675:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: 00000000e080ccaf/0xa113d808b7537957 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b753795e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.296692:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: 00000000e080ccaf/0xa113d808b7537957 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b753795e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.296701:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582655.296703:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582655.296704:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787582655.296714:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787582655.296717:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8da584c3b800 from 21 10000000:01000000:1.0:1787582655.296720:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787582655.296734:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: 00000000bc3dda11/0xa113d808b7537a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.296740:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: 00000000bc3dda11/0xa113d808b7537a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.296747:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: 00000000bc3dda11/0xa113d808b7537a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582655.296759:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007fe50684 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186168320:0@lo:101: 00000100:00100000:1.0:1787582655.296788:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.296804:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f3dc287c going to sleep for 11 seconds 00000100:00100000:1.0:1787582655.296818:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027b1bb42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186168064:0@lo:103: 00000100:00100000:1.0:1787582655.296840:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.296867:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186168192:0@lo:103: 00000100:00100000:1.0:1787582655.296901:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.296930:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186168320 00000100:00100000:1.0:1787582655.296933:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186168320 00000100:00100000:1.0:1787582655.296956:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787582655.296968:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca89a9e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5851:x1874416186168320:12345-0@lo:101: 00010000:00010000:1.0:1787582655.296978:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582655.296987:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee36f396/0xa113d808b7537a29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537a22 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.297001:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.297008:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ee36f396/0xa113d808b7537a29 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537a22 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.297018:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.297028:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee36f396/0xa113d808b7537a29 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537a22 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.297163:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582655.297292:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee36f396, rc 0) 00000100:00100000:1.0:1787582655.297346:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca89a9e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+13:5851:x1874416186168320:12345-0@lo:101: Request processed in 379us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.297352:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787582655.297380:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186168064 00000100:00100000:1.0:1787582655.297384:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186168064 00010000:00010000:1.0:1787582655.297398:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000040f679d2/0xa113d808b75379ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b75379c7 expref: 13 pid: 5848 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582655.297416:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186168192 00000100:00100000:1.0:1787582655.297419:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186168192 00010000:00010000:1.0:1787582655.297428:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000afcdadb1/0xa113d808b753795e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537957 expref: 14 pid: 5847 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582655.297452:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787582655.297457:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a7f2dde pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:3314:x1874416186168064:12345-0@lo:103: 00010000:00010000:1.0:1787582655.297466:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582655.297470:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000040f679d2/0xa113d808b75379ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b75379c7 expref: 14 pid: 5848 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.297480:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000040f679d2/0xa113d808b75379ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b75379c7 expref: 14 pid: 5848 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.297491:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582655.297519:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a7f2dde pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:3314:x1874416186168064:12345-0@lo:103: Request processed in 62us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.297524:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787582655.297537:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787582655.297542:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a93a7a91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:3311:x1874416186168192:12345-0@lo:103: 00010000:00010000:1.0:1787582655.297549:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582655.297552:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000afcdadb1/0xa113d808b753795e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537957 expref: 13 pid: 5847 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.297560:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000afcdadb1/0xa113d808b753795e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537957 expref: 13 pid: 5847 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.297568:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582655.297592:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a93a7a91 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:3311:x1874416186168192:12345-0@lo:103: Request processed in 50us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.297598:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787582655.297634:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027b1bb42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186168064:0@lo:103: 00000100:00100000:1.0:1787582655.297671:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186168192:0@lo:103: 00000100:00100000:2.0:1787582655.297767:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 00000000246c07ef going to sleep for 11 seconds 00010000:00010000:2.0:1787582655.297780:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000040f679d2/0xa113d808b75379ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b75379c7 expref: 12 pid: 5848 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582655.297790:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c00a46d7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5847:1874416186167680:0@lo:104: 00010000:00010000:2.0:1787582655.297809:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000afcdadb1/0xa113d808b753795e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537957 expref: 11 pid: 5847 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582655.297817:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6e22297 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5847:1874416186167808:0@lo:104: 00000100:00100000:0.0:1787582655.297878:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007fe50684 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186168320:0@lo:101: 00010000:00010000:0.0:1787582655.297890:0:5851:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.206.120@tcp lock: 00000000bc3dda11/0xa113d808b7537a22 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.297906:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.206.120@tcp lock: 00000000bc3dda11/0xa113d808b7537a22 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582655.297948:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186167936 00000100:00100000:1.0:1787582655.297952:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186167936 00000100:00100000:1.0:1787582655.297970:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787582655.297975:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d1255ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5847:x1874416186167936:12345-0@lo:104: 00010000:00010000:1.0:1787582655.297982:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: 000000007bb710cd/0xa113d808b753793b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537942 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.298028:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1787582655.298086:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582655.298091:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: 000000007bb710cd/0xa113d808b753793b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537942 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298103:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007bb710cd already unused, calling callback (0000000052b2bf58) 10000000:00010000:0.0:1787582655.298105:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: 000000007bb710cd/0xa113d808b753793b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537942 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298113:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: 000000007bb710cd/0xa113d808b753793b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537942 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582655.298119:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: 000000007bb710cd/0xa113d808b753793b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537942 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582655.298124:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582655.298142:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: 000000007bb710cd/0xa113d808b753793b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537942 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298148:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582655.298160:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: 000000007bb710cd/0xa113d808b753793b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537942 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298166:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: 000000007bb710cd/0xa113d808b753793b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537942 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298176:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582655.298193:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582655.298195:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582655.298201:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787582655.298218:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d0aaf88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186168448:0@lo:103: 00000100:00100000:0.0:1787582655.298245:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.298275:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186168448 00000100:00100000:0.0:1787582655.298278:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186168448 00010000:00010000:0.0:1787582655.298290:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009000b74f/0xa113d808b7537942 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b753793b expref: 11 pid: 5847 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582655.298307:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787582655.298311:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000aea0708 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+11:3311:x1874416186168448:12345-0@lo:103: 00010000:00010000:0.0:1787582655.298350:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582655.298354:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009000b74f/0xa113d808b7537942 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b753793b expref: 11 pid: 5847 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298362:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009000b74f/0xa113d808b7537942 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b753793b expref: 11 pid: 5847 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298373:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298380:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298391:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298398:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298404:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298415:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298419:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001bf2dd2a already unused, calling callback (0000000043411f1f) 00010000:00010000:0.0:1787582655.298422:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298428:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298437:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ee36f396/0xa113d808b7537a29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xa113d808b7537a22 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298442:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee36f396/0xa113d808b7537a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0xa113d808b7537a22 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.298460:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: 00000000ee36f396/0xa113d808b7537a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537a22 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582655.298470:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8e0bdfe pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:MGS:5839:1874416186168576:0@lo:105: 00000100:00100000:0.0:1787582655.298493:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.298508:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a1b92a7d going to sleep for 11 seconds 00000100:00100000:1.0:1787582655.298634:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d1255ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5847:x1874416186167936:12345-0@lo:104: Request processed in 658us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.298641:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787582655.298654:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186168576 00000100:00100000:1.0:1787582655.298657:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186168576 00000100:00100000:1.0:1787582655.298672:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787582655.298677:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f8b85c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5839:x1874416186168576:12345-0@lo:105: 00010000:00010000:1.0:1787582655.298684:0:5836:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.206.120@tcp lock: 00000000bc3dda11/0xa113d808b7537a22 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.298690:0:5836:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.206.120@tcp lock: 00000000bc3dda11/0xa113d808b7537a22 lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.298696:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.206.120@tcp lock: 00000000bc3dda11/0xa113d808b7537a22 lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.298702:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: 00000000bc3dda11/0xa113d808b7537a22 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.298718:0:5836:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.206.120@tcp lock: 00000000bc3dda11/0xa113d808b7537a22 lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.298740:0:5836:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock 00000000bc3dda11) 00000100:00100000:1.0:1787582655.298766:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f8b85c3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5839:x1874416186168576:12345-0@lo:105: Request processed in 89us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.298772:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787582655.298860:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009000b74f/0xa113d808b7537942 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b753793b expref: 11 pid: 5847 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582655.298869:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000623b2ec7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5847:1874416186167936:0@lo:104: 00010000:00010000:2.0:1787582655.298884:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.298891:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.298897:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787582655.298904:0:5847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1787582655.299001:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.206.120@tcp lock: 00000000bc3dda11/0xa113d808b7537a22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.299009:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: 00000000bc3dda11/0xa113d808b7537a22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582655.309461:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8e0bdfe pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:MGS:5839:1874416186168576:0@lo:105: 00010000:00010000:1.0:1787582655.309488:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.309500:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001bf2dd2a/0xa113d808b7537a1b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.309514:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582655.309587:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000aea0708 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+10:3311:x1874416186168448:12345-0@lo:103: Request processed in 11274us (11340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.309596:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787582655.309669:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186168704:0@lo:501: 00000100:00100000:1.0:1787582655.309703:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.309736:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d9788497 going to sleep for 11 seconds 00000100:00100000:1.0:1787582655.309750:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186168704 00000100:00100000:1.0:1787582655.309756:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186168704 00000100:00100000:1.0:1787582655.309783:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787582655.309789:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c17af797 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+10:5851:x1874416186168704:12345-0@lo:501: 00000100:00100000:1.0:1787582655.309978:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c17af797 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+10:5851:x1874416186168704:12345-0@lo:501: Request processed in 189us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.309994:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787582655.310025:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186168704:0@lo:501: 00000100:00100000:1.0:1787582655.310047:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186168832:0@lo:503: 00000100:00100000:1.0:1787582655.310083:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.310096:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d9788497 going to sleep for 11 seconds 00000100:00100000:1.0:1787582655.310106:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186168832 00000100:00100000:1.0:1787582655.310109:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186168832 00000100:00100000:1.0:1787582655.310126:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787582655.310130:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005efd04b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+10:5851:x1874416186168832:12345-0@lo:503: 00000100:00100000:1.0:1787582655.310356:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005efd04b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+10:5851:x1874416186168832:12345-0@lo:503: Request processed in 224us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.310362:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787582655.310400:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186168832:0@lo:503: 00000100:00100000:1.0:1787582655.310590:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:6718:1874416186168960:0@lo:502: 00000100:00100000:1.0:1787582655.310623:0:6718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.310641:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186168960 00000100:00100000:1.0:1787582655.310645:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186168960 00000100:00100000:1.0:1787582655.310664:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787582655.310669:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000badeeaf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+10:6718:x1874416186168960:12345-0@lo:502: 00000100:00100000:1.0:1787582655.310803:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000badeeaf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+10:6718:x1874416186168960:12345-0@lo:502: Request processed in 134us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.310810:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787582655.310840:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f0ec3590 going to sleep for 11 seconds 00000100:00100000:1.0:1787582655.310851:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:6718:1874416186168960:0@lo:502: 00000100:00100000:1.0:1787582655.310897:0:6718:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:6718:1874416186169088:0@lo:502: 00000100:00100000:1.0:1787582655.310926:0:6718:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.310942:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186169088 00000100:00100000:1.0:1787582655.310944:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186169088 00000100:00100000:1.0:1787582655.310960:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787582655.310964:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba6211f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+10:6718:x1874416186169088:12345-0@lo:502: 00000100:00100000:1.0:1787582655.311066:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba6211f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+10:6718:x1874416186169088:12345-0@lo:502: Request processed in 101us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.311072:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787582655.311101:0:6718:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f0ec3590 going to sleep for 11 seconds 00000100:00100000:1.0:1787582655.311111:0:6718:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:6718:1874416186169088:0@lo:502: 00000040:00080000:1.0:1787582655.311127:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787582655.311167:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787582655.311472:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787582655.311481:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: 00000000bc3dda11/0xa113d808b7537a22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.311489:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: 00000000bc3dda11/0xa113d808b7537a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582655.311496:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787582655.311498:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787582655.311501:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787582655.311521:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: 00000000c90dec09/0xa113d808b7537a30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.311527:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: 00000000c90dec09/0xa113d808b7537a30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.311546:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: 00000000c90dec09/0xa113d808b7537a30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582655.311557:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186169216:0@lo:101: 00000100:00100000:1.0:1787582655.311583:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.311605:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f0ec3590 going to sleep for 11 seconds 00000100:00100000:1.0:1787582655.311617:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186169216 00000100:00100000:1.0:1787582655.311620:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186169216 00000100:00100000:1.0:1787582655.311640:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787582655.311645:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e14a196 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+10:5851:x1874416186169216:12345-0@lo:101: 00010000:00010000:1.0:1787582655.311652:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582655.311664:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000afcdadb1/0xa113d808b7537a37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537a30 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.311682:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000afcdadb1/0xa113d808b7537a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537a30 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.311691:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000afcdadb1/0xa113d808b7537a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537a30 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.311698:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000afcdadb1, rc 0) 00000100:00100000:1.0:1787582655.311725:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e14a196 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+11:5851:x1874416186169216:12345-0@lo:101: Request processed in 80us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.311730:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787582655.311757:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186169216:0@lo:101: 00010000:00010000:1.0:1787582655.311768:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: 00000000c90dec09/0xa113d808b7537a30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537a37 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.311785:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: 00000000c90dec09/0xa113d808b7537a30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537a37 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582655.311820:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186169344:0@lo:501: 00000100:00100000:1.0:1787582655.311843:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.311855:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f0ec3590 going to sleep for 11 seconds 00000100:00100000:1.0:1787582655.311865:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186169344 00000100:00100000:1.0:1787582655.311868:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186169344 00000100:00100000:1.0:1787582655.311886:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787582655.311891:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ba523aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+11:5851:x1874416186169344:12345-0@lo:501: 00000100:00100000:1.0:1787582655.312052:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ba523aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+11:5851:x1874416186169344:12345-0@lo:501: Request processed in 160us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.312058:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787582655.312085:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186169344:0@lo:501: 00000100:00100000:1.0:1787582655.312106:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186169472:0@lo:503: 00000100:00100000:1.0:1787582655.312137:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.312148:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f0ec3590 going to sleep for 11 seconds 00000100:00100000:1.0:1787582655.312158:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186169472 00000100:00100000:1.0:1787582655.312161:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186169472 00000100:00100000:2.0:1787582655.312332:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d0aaf88 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186168448:0@lo:103: 00000100:00100000:1.0:1787582655.312384:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787582655.312394:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002335f8eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+11:5851:x1874416186169472:12345-0@lo:503: 00000100:00100000:1.0:1787582655.312560:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002335f8eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+11:5851:x1874416186169472:12345-0@lo:503: Request processed in 169us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.312567:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787582655.314537:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004cae66e1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186169472:0@lo:503: 00000100:00100000:2.0:1787582655.314999:0:6719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000623b2ec7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:6719:1874416186169600:0@lo:502: 00000100:00100000:2.0:1787582655.315053:0:6719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582655.315091:0:6719:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cb79358b going to sleep for 11 seconds 00000100:00100000:1.0:1787582655.315141:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186169600 00000100:00100000:1.0:1787582655.315155:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186169600 00000100:00100000:1.0:1787582655.315215:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787582655.315224:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7216cac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+11:6719:x1874416186169600:12345-0@lo:502: 00000100:00100000:1.0:1787582655.315435:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7216cac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+11:6719:x1874416186169600:12345-0@lo:502: Request processed in 213us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582655.315443:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787582655.315796:0:6719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000623b2ec7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:6719:1874416186169600:0@lo:502: 00000020:01000000:3.0:1787582655.315822:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787582655.315828:0:6719:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787582655.315834:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582655.315836:0:6719:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787582655.315841:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787582655.315844:0:6719:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.120@tcp to nid 0x20000c0a8ce78 (192.168.206.120@tcp) 00000020:01000000:3.0:1787582655.315861:0:6719:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787582655.315863:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787582655.315875:0:6719:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (00000000c8e66357) 00000020:00000080:3.0:1787582655.315896:0:6719:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:3.0:1787582655.315901:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787582655.315965:0:6719:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787582655.315969:0:6719:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787582655.315975:0:6719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa113d808b7537a45 00010000:00080000:3.0:1787582655.316003:0:6719:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000095d5c496@lustre-OST0000-osc-MDT0000: add connection 192.168.206.120@tcp at head 00010000:00010000:3.0:1787582655.316857:0:6719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787582655.363930:0:6719:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787582655.363950:0:6719:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787582655.364587:0:6719:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787582655.364785:0:6719:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787582655.364834:0:6719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787582655.364904:0:6719:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787582655.365778:0:6720:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787582655.365783:0:6720:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1787582655.366153:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbdd2e56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+10:6700:x1874416186167552:12345-0@lo:253: Request processed in 84164us (88164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582655.366170:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787582655.366347:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000067608e75 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186167552:0@lo:253: 10000000:01000000:3.0:1787582655.366361:0:6700:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787582655.366364:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787582655.366366:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787582655.366367:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582655.366368:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787582655.366369:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582655.366370:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582655.366372:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787582655.366373:0:6700:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787582655.366374:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582655.366376:0:6700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787582655.366391:0:6700:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004c513418 from lustre-OST0000 10000000:01000000:3.0:1787582655.366409:0:6700:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787582655.366412:0:6700:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787582655.366419:0:6700:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8da588590000 local copy 10000000:01000000:3.0:1787582655.366422:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787582655.366451:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: 00000000591e48c5/0xa113d808b7537a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.366461:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.120@tcp lock: 00000000591e48c5/0xa113d808b7537a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.366470:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: 00000000591e48c5/0xa113d808b7537a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582655.366492:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c97d20c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186169728:0@lo:101: 00000100:00100000:3.0:1787582655.366538:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582655.366585:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079cbddfd going to sleep for 11 seconds 00000100:00100000:0.0:1787582655.366703:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186169728 00000100:00100000:0.0:1787582655.366710:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186169728 00000100:00100000:0.0:1787582655.366748:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787582655.366756:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000072648dc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+10:6700:x1874416186169728:12345-0@lo:101: 00010000:00010000:0.0:1787582655.366767:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582655.366779:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000245d4d91/0xa113d808b7537a53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537a4c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.366800:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000245d4d91/0xa113d808b7537a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537a4c expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.366809:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000245d4d91/0xa113d808b7537a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537a4c expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.366818:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000245d4d91, rc 0) 00000100:00100000:0.0:1787582655.366851:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000072648dc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+11:6700:x1874416186169728:12345-0@lo:101: Request processed in 97us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582655.366857:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787582655.366889:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c97d20c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186169728:0@lo:101: 00010000:00010000:0.0:1787582655.366902:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: 00000000591e48c5/0xa113d808b7537a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0xa113d808b7537a53 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.366909:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: 00000000591e48c5/0xa113d808b7537a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0xa113d808b7537a53 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582655.366985:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005fad6388 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186169856:0@lo:501: 00000100:00100000:0.0:1787582655.367008:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.367032:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set 000000006dc7b33d going to sleep for 11 seconds 00000100:00100000:0.0:1787582655.367045:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186169856 00000100:00100000:0.0:1787582655.367048:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186169856 00000100:00100000:0.0:1787582655.367065:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787582655.367069:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085c10c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+11:6700:x1874416186169856:12345-0@lo:501: 00000100:00100000:0.0:1787582655.367307:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085c10c22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+11:6700:x1874416186169856:12345-0@lo:501: Request processed in 237us (299us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787582655.367314:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787582655.367370:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005fad6388 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186169856:0@lo:501: 10000000:01000000:0.0:1787582655.367382:0:6700:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787582655.367406:0:6700:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787582655.367410:0:6700:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: 00000000591e48c5/0xa113d808b7537a4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0xa113d808b7537a53 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.367416:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: 00000000591e48c5/0xa113d808b7537a4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0xa113d808b7537a53 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.367421:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.120@tcp lock: 00000000591e48c5/0xa113d808b7537a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000400000000 nid: local remote: 0xa113d808b7537a53 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.367435:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787582655.367450:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8da5a1567000 10000000:01000000:0.0:1787582655.367454:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787582655.367458:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8da588590000 10000000:01000000:0.0:1787582655.367460:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787582655.367463:0:6700:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8da588590000 from 1 10000000:01000000:0.0:1787582655.367465:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787582655.367479:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: 0000000094ff0e7b/0xa113d808b7537a5a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.367496:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: 0000000094ff0e7b/0xa113d808b7537a5a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.367503:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: 0000000094ff0e7b/0xa113d808b7537a5a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582655.367514:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005fad6388 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186169984:0@lo:101: 00000100:00100000:0.0:1787582655.367773:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.367800:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038a15857 going to sleep for 11 seconds 00010000:00010000:0.0:1787582655.367812:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582655.367817:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: 00000000591e48c5/0xa113d808b7537a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xa113d808b7537a53 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.367824:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000591e48c5 already unused, calling callback (0000000052b2bf58) 10000000:00010000:0.0:1787582655.367827:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: 00000000591e48c5/0xa113d808b7537a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0xa113d808b7537a53 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.367835:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: 00000000591e48c5/0xa113d808b7537a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x8400000000 nid: local remote: 0xa113d808b7537a53 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582655.367841:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: 00000000591e48c5/0xa113d808b7537a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x9400000000 nid: local remote: 0xa113d808b7537a53 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582655.367846:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582655.367861:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: 00000000591e48c5/0xa113d808b7537a4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xa113d808b7537a53 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.367867:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582655.367888:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: 00000000591e48c5/0xa113d808b7537a4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xa113d808b7537a53 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.367899:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: 00000000591e48c5/0xa113d808b7537a4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x4809400000020 nid: local remote: 0xa113d808b7537a53 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.367910:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582655.367912:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582655.367913:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582655.367925:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000043dd010c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186170112:0@lo:103: 00000100:00100000:0.0:1787582655.367950:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.367977:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186170112 00000100:00100000:0.0:1787582655.367980:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186170112 00000100:00100000:0.0:1787582655.368005:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787582655.368010:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011fe0672 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+11:3313:x1874416186170112:12345-0@lo:103: 00010000:00010000:0.0:1787582655.368018:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582655.368028:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000245d4d91/0xa113d808b7537a53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa113d808b7537a4c expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.368038:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582655.368060:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011fe0672 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+10:3313:x1874416186170112:12345-0@lo:103: Request processed in 50us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582655.368066:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787582655.368089:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000043dd010c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186170112:0@lo:103: 00000100:00100000:2.0:1787582655.368138:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186169984 00000100:00100000:2.0:1787582655.368142:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186169984 00000100:00100000:2.0:1787582655.368166:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787582655.368171:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e221cf6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+10:6700:x1874416186169984:12345-0@lo:101: 00010000:00010000:2.0:1787582655.368188:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582655.368202:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e95221ff/0xa113d808b7537a61 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537a5a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.368225:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e95221ff/0xa113d808b7537a61 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537a5a expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.368232:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e95221ff/0xa113d808b7537a61 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537a5a expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.368237:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e95221ff, rc 0) 00000100:00100000:2.0:1787582655.368265:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e221cf6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+11:6700:x1874416186169984:12345-0@lo:101: Request processed in 95us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582655.368270:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787582655.368467:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005fad6388 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186169984:0@lo:101: 00010000:00010000:0.0:1787582655.368480:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: 0000000094ff0e7b/0xa113d808b7537a5a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537a61 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.368487:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: 0000000094ff0e7b/0xa113d808b7537a5a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537a61 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582655.368505:0:6700:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787582655.368509:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: 0000000094ff0e7b/0xa113d808b7537a5a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537a61 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.368514:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: 0000000094ff0e7b/0xa113d808b7537a5a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537a61 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582655.368521:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787582655.368601:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787582655.368607:0:6700:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787582655.368609:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787582655.368622:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: 00000000b6fe2e0d/0xa113d808b7537a68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.368628:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: 00000000b6fe2e0d/0xa113d808b7537a68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.368634:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: 00000000b6fe2e0d/0xa113d808b7537a68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582655.368645:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005fad6388 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186170240:0@lo:101: 00000100:00100000:0.0:1787582655.368668:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.368682:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038a15857 going to sleep for 11 seconds 00000100:00100000:2.0:1787582655.368726:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186170240 00000100:00100000:2.0:1787582655.368730:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186170240 00000100:00100000:2.0:1787582655.368786:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787582655.368792:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbd3c606 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+11:6700:x1874416186170240:12345-0@lo:101: 00010000:00010000:2.0:1787582655.368798:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582655.368804:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e97eee44/0xa113d808b7537a6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537a68 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.368815:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e97eee44/0xa113d808b7537a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537a68 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.368821:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e97eee44/0xa113d808b7537a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537a68 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.368828:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e97eee44, rc 0) 00000100:00100000:2.0:1787582655.368858:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbd3c606 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+12:6700:x1874416186170240:12345-0@lo:101: Request processed in 67us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582655.368871:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000020:00000080:1.0:1787582655.369364:0:6719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787582655.369375:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787582655.369416:0:6719:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787582655.369434:0:6719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa113d808b7537a76 00000100:00080000:1.0:1787582655.369441:0:6719:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787582655.369445:0:6719:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import 0000000095d5c496 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:1.0:1787582655.369467:0:6719:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000027b1bb42 x1874416186170368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787582655.369485:0:6719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787582655.369547:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582655.369551:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582655.369553:0:6719:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787582655.369556:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582655.369559:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582655.369560:0:6719:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787582655.369563:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787582655.369564:0:6719:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787582655.369584:0:6719:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000056c0a0c1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:6719:1874416186170496:0@lo:502: 00000100:00100000:1.0:1787582655.369630:0:6719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.369691:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005fad6388 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186170240:0@lo:101: 00010000:00010000:0.0:1787582655.369705:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: 00000000b6fe2e0d/0xa113d808b7537a68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537a6f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.369713:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: 00000000b6fe2e0d/0xa113d808b7537a68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537a6f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582655.369801:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005fad6388 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186170624:0@lo:501: 00000100:00100000:0.0:1787582655.369828:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.370167:0:6719:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb24a92e going to sleep for 11 seconds 00000100:00100000:1.0:1787582655.370193:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027b1bb42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186170368:0@lo:8: 00000100:00100000:1.0:1787582655.370242:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.370287:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186170368 00000100:00100000:1.0:1787582655.370292:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186170368 00000100:00100000:1.0:1787582655.370312:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582655.370335:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000190f5771 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874416186170368:12345-0@lo:8: 00010000:00020000:1.0:1787582655.370348:0:6703:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787582655.370382:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000190f5771 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874416186170368:12345-0@lo:8: Request processed in 46us (140us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787582655.370388:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787582655.370415:0:3310:0:(import.c:65:import_set_state_nolock()) 0000000095d5c496 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787582655.370420:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787582655.370422:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027b1bb42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186170368:0@lo:8: 00000100:00100000:0.0:1787582655.370500:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038a15857 going to sleep for 11 seconds 00000100:00100000:3.0:1787582655.370616:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186170496 00000100:00100000:3.0:1787582655.370621:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186170496 00000100:00100000:3.0:1787582655.370644:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186170624 00000100:00100000:3.0:1787582655.370646:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186170624 00000100:00100000:3.0:1787582655.370658:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787582655.370663:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b10b05c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:6719:x1874416186170496:12345-0@lo:502: 00000100:00100000:3.0:1787582655.370875:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b10b05c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:6719:x1874416186170496:12345-0@lo:502: Request processed in 211us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582655.370883:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787582655.370911:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787582655.370917:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be813bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+12:6700:x1874416186170624:12345-0@lo:501: 00000100:00100000:3.0:1787582655.371095:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be813bf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+12:6700:x1874416186170624:12345-0@lo:501: Request processed in 178us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582655.371102:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787582655.371240:0:6719:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000056c0a0c1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:6719:1874416186170496:0@lo:502: 00000020:01000000:0.0:1787582655.371267:0:6719:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582655.371272:0:6719:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582655.371275:0:6719:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787582655.371278:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1787582655.371435:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005fad6388 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186170624:0@lo:501: 00000100:00100000:0.0:1787582655.371466:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005fad6388 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186170752:0@lo:503: 00000100:00100000:0.0:1787582655.371500:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.371515:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038a15857 going to sleep for 11 seconds 00000020:01000000:3.0:1787582655.371624:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787582655.371642:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787582655.371650:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: 00000000c90dec09/0xa113d808b7537a30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537a37 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.371659:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: 00000000c90dec09/0xa113d808b7537a30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537a37 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582655.371668:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787582655.371675:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da584c3b800 from 1 10000000:01000000:3.0:1787582655.371678:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787582655.371697:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: 00000000e8cd7547/0xa113d808b7537a7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.371704:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: 00000000e8cd7547/0xa113d808b7537a7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.371711:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: 00000000e8cd7547/0xa113d808b7537a7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582655.371720:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000864bf58c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186170880:0@lo:101: 00000100:00100000:3.0:1787582655.371743:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582655.371762:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079cbddfd going to sleep for 11 seconds 00000100:00100000:3.0:1787582655.371773:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186170752 00000100:00100000:3.0:1787582655.371777:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186170752 00000100:00100000:3.0:1787582655.371792:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186170880 00000100:00100000:3.0:1787582655.371794:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186170880 00000100:00100000:3.0:1787582655.371803:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787582655.371807:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000355e3386 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:6700:x1874416186170752:12345-0@lo:503: 00000100:00100000:3.0:1787582655.371928:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000355e3386 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:6700:x1874416186170752:12345-0@lo:503: Request processed in 120us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582655.371934:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787582655.371956:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787582655.371961:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abad9195 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5851:x1874416186170880:12345-0@lo:101: 00010000:00010000:3.0:1787582655.371968:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582655.371977:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a2b6b068/0xa113d808b7537a84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537a7d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.371994:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a2b6b068/0xa113d808b7537a84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537a7d expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.372009:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a2b6b068/0xa113d808b7537a84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537a7d expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.372016:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a2b6b068, rc 0) 00000100:00100000:3.0:1787582655.372039:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abad9195 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:5851:x1874416186170880:12345-0@lo:101: Request processed in 78us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582655.372044:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787582655.372069:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000864bf58c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186170880:0@lo:101: 00010000:00010000:3.0:1787582655.372078:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: 00000000e8cd7547/0xa113d808b7537a7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537a84 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.372085:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: 00000000e8cd7547/0xa113d808b7537a7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537a84 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582655.372116:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000864bf58c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186171008:0@lo:501: 00000100:00100000:3.0:1787582655.372135:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582655.372146:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079cbddfd going to sleep for 11 seconds 00000100:00100000:3.0:1787582655.372155:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186171008 00000100:00100000:3.0:1787582655.372158:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186171008 00000100:00100000:3.0:1787582655.372170:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787582655.372175:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbca9572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:5851:x1874416186171008:12345-0@lo:501: 00000100:00100000:3.0:1787582655.372368:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbca9572 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:5851:x1874416186171008:12345-0@lo:501: Request processed in 192us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582655.372374:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787582655.372400:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000864bf58c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186171008:0@lo:501: 00000100:00100000:3.0:1787582655.372420:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000864bf58c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186171136:0@lo:503: 00000100:00100000:3.0:1787582655.372459:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582655.372471:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079cbddfd going to sleep for 11 seconds 00000100:00100000:3.0:1787582655.372483:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186171136 00000100:00100000:3.0:1787582655.372485:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186171136 00000100:00100000:3.0:1787582655.372500:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787582655.372505:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1bf36ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:5851:x1874416186171136:12345-0@lo:503: 00000100:00100000:0.0:1787582655.372647:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005fad6388 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186170752:0@lo:503: 00000040:00080000:0.0:1787582655.372892:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787582655.372950:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005fad6388 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186171264:0@lo:502: 00000100:00100000:0.0:1787582655.372986:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.372995:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038a15857 going to sleep for 11 seconds 00000100:00100000:2.0:1787582655.373176:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186171264 00000100:00100000:2.0:1787582655.373181:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186171264 00000100:00100000:2.0:1787582655.373202:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787582655.373218:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2064207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:6700:x1874416186171264:12345-0@lo:502: 00000100:00100000:2.0:1787582655.373402:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2064207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:6700:x1874416186171264:12345-0@lo:502: Request processed in 194us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582655.373409:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787582655.373655:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005fad6388 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186171264:0@lo:502: 00000040:00080000:0.0:1787582655.373870:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787582655.373915:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787582655.373944:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787582655.373983:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787582655.374012:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787582655.374038:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787582655.374060:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005fad6388 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186171392:0@lo:502: 00000100:00100000:0.0:1787582655.374099:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.374134:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038a15857 going to sleep for 11 seconds 00000100:00100000:2.0:1787582655.374629:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186171392 00000100:00100000:2.0:1787582655.374635:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186171392 00000100:00100000:2.0:1787582655.374676:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787582655.374683:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e001267d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:6700:x1874416186171392:12345-0@lo:502: 00000100:00100000:2.0:1787582655.374837:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e001267d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:6700:x1874416186171392:12345-0@lo:502: Request processed in 154us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582655.374844:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787582655.375006:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1bf36ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:5851:x1874416186171136:12345-0@lo:503: Request processed in 2500us (2546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582655.375013:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787582655.375107:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000864bf58c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186171136:0@lo:503: 00000100:00100000:0.0:1787582655.375435:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005fad6388 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186171392:0@lo:502: 00000040:00080000:0.0:1787582655.375651:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787582655.375665:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1787582655.376043:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787582655.376050:0:6724:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787582655.376057:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582655.376059:0:6724:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787582655.376062:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787582655.376076:0:6724:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000e9540631) 00000020:00000080:0.0:1787582655.376094:0:6724:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787582655.376100:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787582655.376173:0:6724:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004c513418 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787582655.376180:0:6724:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787582655.376188:0:6724:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa113d808b7537a92 00000100:00100000:2.0:1787582655.379677:0:6723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6e22297 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:6723:1874416186171520:0@lo:502: 00000100:00100000:2.0:1787582655.379753:0:6723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582655.379793:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186171520 00000100:00100000:2.0:1787582655.379801:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186171520 00000100:00100000:2.0:1787582655.379835:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787582655.379842:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076d19279 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:6723:x1874416186171520:12345-0@lo:502: 00000100:00100000:2.0:1787582655.380050:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076d19279 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:6723:x1874416186171520:12345-0@lo:502: Request processed in 208us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582655.380057:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787582655.380110:0:6723:0:(client.c:2715:ptlrpc_set_wait()) set 000000004bf7caea going to sleep for 11 seconds 00000100:00100000:2.0:1787582655.380129:0:6723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6e22297 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:6723:1874416186171520:0@lo:502: 00000020:01000000:2.0:1787582655.380154:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582655.380162:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582655.380165:0:6723:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787582655.380170:0:6723:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8da584c3b800 00000020:00000080:2.0:1787582655.380173:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787582655.380218:0:6723:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:6723:1874416186171648:0@lo:502: 00000100:00100000:2.0:1787582655.380250:0:6723:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582655.380263:0:6723:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a0640c00 going to sleep for 11 seconds 00010000:00010000:0.0:1787582655.381460:0:6724:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000100:00100000:3.0:1787582655.381720:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186171648 00000100:00100000:3.0:1787582655.381728:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186171648 00000100:00100000:3.0:1787582655.381776:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787582655.381785:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:6723:x1874416186171648:12345-0@lo:502: 00000100:00100000:3.0:1787582655.381969:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:6723:x1874416186171648:12345-0@lo:502: Request processed in 184us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582655.381976:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787582655.382028:0:6723:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:6723:1874416186171648:0@lo:502: 00000020:01000000:3.0:1787582655.382056:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582655.382062:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582655.382064:0:6723:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787582655.382068:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787582655.382121:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787582655.382136:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787582655.382145:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7537a7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537a84 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.382156:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7537a7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537a84 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582655.382174:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787582655.382177:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8da588590000 from 1 10000000:01000000:3.0:1787582655.382180:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787582655.382216:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee400/0xa113d808b7537a99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.382224:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee400/0xa113d808b7537a99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.382232:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee400/0xa113d808b7537a99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582655.382248:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186171776:0@lo:101: 00000100:00100000:3.0:1787582655.382284:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582655.382309:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58df5a540 going to sleep for 11 seconds 00000100:00100000:3.0:1787582655.382337:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186171776 00000100:00100000:3.0:1787582655.382341:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186171776 00000100:00100000:3.0:1787582655.382360:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787582655.382365:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:5851:x1874416186171776:12345-0@lo:101: 00010000:00010000:3.0:1787582655.382373:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582655.382384:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5c20ef800/0xa113d808b7537aa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537a99 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.382404:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5c20ef800/0xa113d808b7537aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537a99 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.382413:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5c20ef800/0xa113d808b7537aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537a99 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.382432:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ef800, rc 0) 00000100:00100000:3.0:1787582655.382460:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:5851:x1874416186171776:12345-0@lo:101: Request processed in 94us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582655.382467:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787582655.382494:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186171776:0@lo:101: 00010000:00010000:3.0:1787582655.382506:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee400/0xa113d808b7537a99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537aa0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.382515:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee400/0xa113d808b7537a99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537aa0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582655.382903:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186171904:0@lo:501: 00000100:00100000:3.0:1787582655.382927:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582655.383021:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58df5a540 going to sleep for 11 seconds 00000001:02000400:0.0:1787582655.383412:0:6724:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000100:00100000:2.0:1787582655.383613:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186171904 00000100:00100000:2.0:1787582655.383619:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186171904 00000100:00100000:2.0:1787582655.383685:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787582655.383693:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:5851:x1874416186171904:12345-0@lo:501: 00000100:00100000:2.0:1787582655.383864:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:5851:x1874416186171904:12345-0@lo:501: Request processed in 172us (936us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787582655.383871:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787582655.385660:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186171904:0@lo:501: 10000000:01000000:3.0:1787582655.385702:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787582655.385712:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee400/0xa113d808b7537a99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537aa0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582655.385722:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee400/0xa113d808b7537a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537aa0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1787582655.386632:0:6724:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787582655.386903:0:6724:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1787582655.393817:0:6724:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787582655.394365:0:6724:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787582655.396618:0:6724:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787582655.396630:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582655.396636:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582655.396638:0:6724:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787582655.396642:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787582655.396646:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582655.396647:0:6724:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787582655.396650:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787582655.396652:0:6724:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787582655.396704:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582655.396707:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582655.396708:0:6724:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787582655.396711:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787582655.396852:0:6700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787582655.396874:0:6700:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787582655.396897:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da580031a00/0xa113d808b7537a68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537a6f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.396908:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da580031a00/0xa113d808b7537a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537a6f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582655.396916:0:6700:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da5a1567000 from 1 10000000:01000000:1.0:1787582655.396918:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787582655.396950:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687600/0xa113d808b7537aa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.396967:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da581687600/0xa113d808b7537aa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.396978:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da581687600/0xa113d808b7537aa7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582655.397001:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172032:0@lo:101: 00000100:00100000:1.0:1787582655.397067:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.397116:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf3d9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787582655.397228:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186172032 00000100:00100000:2.0:1787582655.397235:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186172032 00000100:00100000:2.0:1787582655.397281:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787582655.397290:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:6700:x1874416186172032:12345-0@lo:101: 00010000:00010000:2.0:1787582655.397304:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582655.397342:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da58147fa00/0xa113d808b7537aae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537aa7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.397368:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da58147fa00/0xa113d808b7537aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537aa7 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.397377:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da58147fa00/0xa113d808b7537aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537aa7 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.397392:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147fa00, rc 0) 00000100:00100000:2.0:1787582655.397436:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:6700:x1874416186172032:12345-0@lo:101: Request processed in 146us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582655.397442:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787582655.397673:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172032:0@lo:101: 00010000:00010000:0.0:1787582655.397688:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da581687600/0xa113d808b7537aa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537aae expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.397697:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da581687600/0xa113d808b7537aa7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537aae expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582655.397791:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172160:0@lo:501: 00000100:00100000:0.0:1787582655.397818:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.397838:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58b34d900 going to sleep for 11 seconds 00000100:00100000:2.0:1787582655.397888:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186172160 00000100:00100000:2.0:1787582655.397893:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186172160 00000100:00100000:2.0:1787582655.397990:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787582655.397998:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+15:6700:x1874416186172160:12345-0@lo:501: 00000100:00100000:2.0:1787582655.398224:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+15:6700:x1874416186172160:12345-0@lo:501: Request processed in 226us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582655.398232:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787582655.398421:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172160:0@lo:501: 00000100:00100000:0.0:1787582655.398448:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172288:0@lo:503: 00000100:00100000:0.0:1787582655.398486:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.398506:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58b34d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787582655.398518:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186172288 00000100:00100000:0.0:1787582655.400273:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186172288 00000100:00100000:0.0:1787582655.400328:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787582655.400336:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:6700:x1874416186172288:12345-0@lo:503: 00000100:00100000:0.0:1787582655.400507:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:6700:x1874416186172288:12345-0@lo:503: Request processed in 171us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582655.400515:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787582655.400648:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172288:0@lo:503: 00000040:00080000:0.0:1787582655.400915:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787582655.400980:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172416:0@lo:502: 00000100:00100000:0.0:1787582655.401021:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.401048:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58b34d900 going to sleep for 11 seconds 00000100:00100000:0.0:1787582655.401063:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186172416 00000100:00100000:0.0:1787582655.401068:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186172416 00000100:00100000:0.0:1787582655.401087:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787582655.401093:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:6700:x1874416186172416:12345-0@lo:502: 00000100:00100000:0.0:1787582655.401683:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:6700:x1874416186172416:12345-0@lo:502: Request processed in 587us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582655.401691:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787582655.401734:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172416:0@lo:502: 00000040:00080000:0.0:1787582655.401966:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787582655.402009:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787582655.402030:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172544:0@lo:502: 00000100:00100000:0.0:1787582655.402061:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.402082:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a08cb240 going to sleep for 11 seconds 00000100:00100000:0.0:1787582655.402094:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186172544 00000100:00100000:0.0:1787582655.402097:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186172544 00000100:00100000:0.0:1787582655.402115:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787582655.402121:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:6700:x1874416186172544:12345-0@lo:502: 00000100:00100000:0.0:1787582655.402256:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:6700:x1874416186172544:12345-0@lo:502: Request processed in 134us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582655.402263:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787582655.402295:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172544:0@lo:502: 00000040:00080000:0.0:1787582655.402379:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787582655.402388:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787582655.404037:0:6728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582655.404047:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582655.404050:0:6728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787582655.404056:0:6728:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8da5a1567000 00000020:00000080:3.0:1787582655.404063:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787582655.404082:0:6728:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582655.404085:0:6728:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582655.404087:0:6728:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787582655.404089:0:6728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787582655.404270:0:6700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787582655.404293:0:6700:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787582655.404311:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687600/0xa113d808b7537aa7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537aae expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.404335:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da581687600/0xa113d808b7537aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537aae expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582655.404377:0:6700:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787582655.404380:0:6700:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8da5a1567000 10000000:01000000:1.0:1787582655.404383:0:6700:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8da5a1567000 10000000:01000000:1.0:1787582655.404386:0:6700:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787582655.404391:0:6700:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8da5a1567000 from 1 10000000:01000000:1.0:1787582655.404394:0:6700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787582655.404424:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687200/0xa113d808b7537ab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.404432:0:6700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da581687200/0xa113d808b7537ab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582655.404454:0:6700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da581687200/0xa113d808b7537ab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582655.404475:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172672:0@lo:101: 00000100:00100000:1.0:1787582655.404538:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.404574:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf3d93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582655.404756:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186172672 00000100:00100000:0.0:1787582655.404768:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186172672 00000100:00100000:0.0:1787582655.404802:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787582655.404811:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:6700:x1874416186172672:12345-0@lo:101: 00010000:00010000:0.0:1787582655.404823:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582655.404835:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da580030e00/0xa113d808b7537abc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537ab5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.404855:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da580030e00/0xa113d808b7537abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537ab5 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.404865:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da580030e00/0xa113d808b7537abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537ab5 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.404873:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580030e00, rc 0) 00000100:00100000:0.0:1787582655.404908:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:6700:x1874416186172672:12345-0@lo:101: Request processed in 99us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582655.404914:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787582655.404951:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172672:0@lo:101: 00010000:00010000:0.0:1787582655.404965:0:6700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da581687200/0xa113d808b7537ab5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537abc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.404974:0:6700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da581687200/0xa113d808b7537ab5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537abc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582655.405050:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172800:0@lo:501: 00000100:00100000:0.0:1787582655.405074:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.405092:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a08cb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582655.405104:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186172800 00000100:00100000:0.0:1787582655.405107:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186172800 00000100:00100000:0.0:1787582655.405131:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787582655.405137:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:6700:x1874416186172800:12345-0@lo:501: 00000100:00100000:0.0:1787582655.405708:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:6700:x1874416186172800:12345-0@lo:501: Request processed in 569us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582655.405716:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787582655.407121:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172800:0@lo:501: 00000100:00100000:1.0:1787582655.407173:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172928:0@lo:503: 00000100:00100000:1.0:1787582655.407251:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582655.407286:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf3d9900 going to sleep for 11 seconds 00000100:00100000:0.0:1787582655.408423:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186172928 00000100:00100000:0.0:1787582655.408434:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186172928 00000100:00100000:0.0:1787582655.408473:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787582655.408481:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:6700:x1874416186172928:12345-0@lo:503: 00000100:00100000:0.0:1787582655.409459:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:6700:x1874416186172928:12345-0@lo:503: Request processed in 974us (2205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582655.409469:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787582655.409639:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186172928:0@lo:503: 00000040:00080000:2.0:1787582655.409930:0:6700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787582655.409992:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186173056:0@lo:502: 00000100:00100000:2.0:1787582655.410038:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582655.410076:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5834ec240 going to sleep for 11 seconds 00000100:00100000:0.0:1787582655.410122:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186173056 00000100:00100000:0.0:1787582655.410128:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186173056 00000100:00100000:0.0:1787582655.410162:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787582655.410169:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:6700:x1874416186173056:12345-0@lo:502: 00000100:00100000:0.0:1787582655.410452:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:6700:x1874416186173056:12345-0@lo:502: Request processed in 282us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582655.410459:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787582655.410602:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186173056:0@lo:502: 00000040:00080000:2.0:1787582655.410818:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787582655.410861:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787582655.410887:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787582655.410934:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787582655.410965:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787582655.411003:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787582655.411031:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787582655.411057:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787582655.411094:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787582655.411131:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787582655.411157:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787582655.411729:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787582655.411778:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787582655.411823:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787582655.411868:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787582655.411901:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787582655.411932:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787582655.411994:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787582655.412032:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787582655.412066:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787582655.412110:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787582655.412142:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787582655.412169:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787582655.413050:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787582655.413094:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787582655.413130:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787582655.413259:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787582655.413304:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1787582655.413491:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186173184:0@lo:502: 00000100:00100000:2.0:1787582655.413638:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582655.413714:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c7ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787582655.413756:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186173184 00000100:00100000:0.0:1787582655.413762:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186173184 00000100:00100000:0.0:1787582655.413836:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787582655.413845:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:6700:x1874416186173184:12345-0@lo:502: 00000100:00100000:0.0:1787582655.414054:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:6700:x1874416186173184:12345-0@lo:502: Request processed in 209us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582655.414062:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787582655.414140:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186173184:0@lo:502: 00000040:00080000:1.0:1787582655.414243:0:6700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787582655.414256:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787582655.415104:0:6729:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787582655.415120:0:6729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8da589c28000) 00000020:00000080:1.0:1787582655.415142:0:6729:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lwp with refcount 2 00000020:01000004:1.0:1787582655.415244:0:6729:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8da5a1567000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787582655.415248:0:6729:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8da5a1567000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787582655.415250:0:6729:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8da5a1567000 3 00010000:00080000:1.0:1787582655.415277:0:6729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8da5bbba3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.120@tcp at head 00010000:00010000:1.0:1787582655.418155:0:6729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-3 is initialized 00000020:00000080:0.0:1787582655.418810:0:6729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787582655.418855:0:6729:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787582655.418866:0:6729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa113d808b7537aca 00000100:00080000:0.0:1787582655.418876:0:6729:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787582655.418880:0:6729:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8da5bbba3800 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:0.0:1787582655.418910:0:6729:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5adbcf800 x1874416186173312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787582655.418960:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874416186173312:0@lo:38: 00000100:00100000:1.0:1787582655.419018:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582655.419092:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186173312 00000100:00100000:3.0:1787582655.419099:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186173312 00000100:00100000:3.0:1787582655.419126:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787582655.419133:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874416186173312:12345-0@lo:38: 00010000:00080000:3.0:1787582655.419152:0:5855:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:3.0:1787582655.419189:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa113d808b7537ad1 00000004:00100000:3.0:1787582655.419202:0:5855:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787582655.419235:0:5855:0:(import.c:65:import_set_state_nolock()) ffff8da5bf3e5000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1787582655.419674:0:6729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787582655.421514:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874416186173312:12345-0@lo:38: Request processed in 2372us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582655.421537:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1787582655.423458:0:6729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787582655.423623:0:6700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787582655.423650:0:6700:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787582655.423665:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687200/0xa113d808b7537ab5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537abc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.423676:0:6700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da581687200/0xa113d808b7537ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537abc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787582655.423723:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787582655.423728:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787582655.423729:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582655.423730:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582655.423732:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582655.423733:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582655.423734:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787582655.423735:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787582655.423737:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787582655.423738:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582655.423739:0:6700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787582655.423743:0:6700:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787582655.423745:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787582655.423746:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787582655.423747:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582655.423749:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582655.423749:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582655.423750:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582655.423751:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787582655.423752:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787582655.423753:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787582655.423754:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582655.423755:0:6700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787582655.423785:0:6700:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787582655.423800:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186173440:0@lo:253: 00000100:00100000:2.0:1787582655.423856:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582655.423894:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c7ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787582655.424026:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186173440 00000100:00100000:0.0:1787582655.424032:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186173440 00000100:00100000:0.0:1787582655.424070:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787582655.424079:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:6700:x1874416186173440:12345-0@lo:253: 20000000:01000000:0.0:1787582655.424103:0:5848:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787582655.424116:0:5848:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1787582655.425895:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8da5adbcf800 x1874416186173312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787582665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582655.425910:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787582655.425925:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787582655.425932:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787582655.425936:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787582655.425940:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5bbba3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787582655.425947:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874416186173312:0@lo:38: 20000000:01000000:0.0:1787582655.455764:0:5848:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787582655.455781:0:5848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787582655.455823:0:5869:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787582655.455827:0:5869:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787582655.455846:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8da58147fc00/0xa113d808b7537ad8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.455864:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5c20efa00/0xa113d808b75379f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b75379f1 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.455871:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8da58147fc00/0xa113d808b7537ad8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.455919:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5c20efa00/0xa113d808b75379f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b75379f1 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.455932:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da5c20efa00/0xa113d808b75379f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b75379f1 expref: 16 pid: 5848 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582655.455946:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5869:1874416186173568:0@lo:104: 00000100:00100000:2.0:1787582655.456005:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582655.456054:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c7ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787582655.456354:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787582655.456383:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186173568 00000100:00100000:0.0:1787582655.456389:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186173568 00000100:00100000:0.0:1787582655.456425:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787582655.456433:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5869:x1874416186173568:12345-0@lo:104: 00010000:00010000:0.0:1787582655.456446:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b75379f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b75379f8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.456500:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787582655.456506:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5869:x1874416186173568:12345-0@lo:104: Request processed in 74us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582655.456513:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787582655.456718:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582655.456724:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b75379f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b75379f8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.456737:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581687e00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582655.456741:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b75379f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b75379f8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.456750:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b75379f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b75379f8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582655.456757:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b75379f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b75379f8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582655.456762:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582655.456827:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b75379f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b75379f8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.456833:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582655.456849:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b75379f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b75379f8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.456856:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b75379f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b75379f8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.456870:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582655.456872:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582655.456874:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582655.456885:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186173696:0@lo:103: 00000100:00100000:0.0:1787582655.456914:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582655.456952:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186173696 00000100:00100000:0.0:1787582655.456956:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186173696 00010000:00010000:0.0:1787582655.456971:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5c20efa00/0xa113d808b75379f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b75379f1 expref: 17 pid: 5848 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582655.456998:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787582655.457004:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5911aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:3314:x1874416186173696:12345-0@lo:103: 00010000:00010000:0.0:1787582655.457014:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582655.457019:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5c20efa00/0xa113d808b75379f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b75379f1 expref: 17 pid: 5848 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.457029:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5c20efa00/0xa113d808b75379f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b75379f1 expref: 17 pid: 5848 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.457044:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8da58147fc00/0xa113d808b7537ad8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.457051:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da58147fc00/0xa113d808b7537ad8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787582655.457063:0:5839:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004892834s 00010000:00010000:0.0:1787582655.457066:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da58147fc00/0xa113d808b7537ad8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.457073:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da58147fc00/0xa113d808b7537ad8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.457080:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8da58147fc00/0xa113d808b7537ad8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.457085:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8da58147fc00/0xa113d808b7537ad8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.457091:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147fc00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582655.457095:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8da58147fc00/0xa113d808b7537ad8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.457107:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8da58147fc00/0xa113d808b7537ad8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.457115:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8da58147fc00/0xa113d808b7537ad8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582655.457123:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582655.457151:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5911aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:3314:x1874416186173696:12345-0@lo:103: Request processed in 148us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582655.457158:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787582655.457229:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186173696:0@lo:103: 00010000:00010000:2.0:1787582655.457300:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5c20efa00/0xa113d808b75379f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b75379f1 expref: 16 pid: 5848 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582655.457311:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5869:1874416186173568:0@lo:104: 00010000:00010000:2.0:1787582655.457345:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8da58147fc00/0xa113d808b7537ad8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.457354:0:5869:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8da58147fc00/0xa113d808b7537ad8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.457361:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8da58147fc00/0xa113d808b7537ad8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582655.457368:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da58147fc00/0xa113d808b7537ad8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582655.467855:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:6700:x1874416186173440:12345-0@lo:253: Request processed in 43768us (43989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582655.467870:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787582655.467947:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:6700:1874416186173440:0@lo:253: 10000000:01000000:0.0:1787582655.467962:0:6700:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787582655.467966:0:6700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787582655.467967:0:6700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787582655.467969:0:6700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787582655.467970:0:6700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787582655.467971:0:6700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787582655.467972:0:6700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787582655.467974:0:6700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787582655.467976:0:6700:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787582655.467977:0:6700:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787582655.467979:0:6700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787582655.467980:0:6700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787582655.467993:0:6700:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787582655.472229:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787582655.472450:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787582655.472863:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787582655.473047:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787582655.473955:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787582655.474645:0:6700:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787582655.476242:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787582655.725360:0:6700:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787582655.725368:0:6700:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787582655.725400:0:6700:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787582655.725452:0:6700:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787582655.725467:0:6700:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787582655.725492:0:6700:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787582655.964819:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582656.977983:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582658.000509:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582659.024467:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582660.048790:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787582660.689013:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787582660.689023:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787582660.689027:0:37:0:(import.c:65:import_set_state_nolock()) ffff8da5bf3e6800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787582660.689035:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 196 00000100:00080000:2.0:1787582660.689040:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787582660.689047:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8da5bf3e6800 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:2.0:1787582660.689067:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5855c1500 x1874416186174080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787582660.689163:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186173952:0@lo:400: 00000100:00100000:1.0:1787582660.689235:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582660.689297:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582660.689303:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186173824:0@lo:400: 00000100:00100000:1.0:1787582660.689346:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582660.689375:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186174080:0@lo:8: 00000100:00100000:1.0:1787582660.689399:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582660.689424:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186173824 00000100:00100000:1.0:1787582660.689430:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186173824 00000100:00100000:1.0:1787582660.689466:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787582660.689474:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+15:3312:x1874416186173824:12345-0@lo:400: 00000100:00100000:1.0:1787582660.689513:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+15:3312:x1874416186173824:12345-0@lo:400: Request processed in 39us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582660.689519:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787582660.689551:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186174080 00000100:00100000:1.0:1787582660.689554:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186174080 00000100:00100000:1.0:1787582660.689580:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582660.689584:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874416186174080:12345-0@lo:8: 00010000:00080000:1.0:1787582660.689604:0:6705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:1.0:1787582660.689631:0:6705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa113d808b7537adf 00002000:00100000:1.0:1787582660.689668:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8da5aefaf000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787582660.689672:0:6705:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787582660.689676:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787582660.689789:0:6705:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787582660.689937:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787582660.689957:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8da5aefaf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582660.689993:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874416186174080:12345-0@lo:8: Request processed in 407us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582660.690000:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787582660.690037:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5855c1500 x1874416186174080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787582675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582660.690046:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787582660.690052:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787582660.690059:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787582660.690063:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787582660.690065:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5bf3e6800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787582660.690077:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787582660.690082:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186174080:0@lo:8: 00000004:00080000:1.0:1787582660.690211:0:6720:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787582660.690575:0:6720:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 201697256228ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787582660.691110:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186173824:0@lo:400: 00000100:00100000:0.0:1787582660.692159:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186174208:0@lo:400: 00000100:00100000:0.0:1787582660.692235:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582660.692294:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186173952 00000100:00100000:0.0:1787582660.692301:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186173952 00000100:00100000:0.0:1787582660.692352:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186174208 00000100:00100000:0.0:1787582660.692355:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186174208 00000100:00100000:0.0:1787582660.692379:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787582660.692387:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186173952:12345-0@lo:400: 00000100:00100000:0.0:1787582660.692433:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186173952:12345-0@lo:400: Request processed in 46us (3198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582660.692440:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787582660.692453:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787582660.692459:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186174208:12345-0@lo:400: 00000100:00100000:0.0:1787582660.692503:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186174208:12345-0@lo:400: Request processed in 44us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582660.692509:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787582660.692539:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5855c0380 x1874416186174208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582660.692552:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186174208:0@lo:400: 00010000:00080000:0.0:1787582660.692575:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5855c1c00 x1874416186173952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582660.692585:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186173952:0@lo:400: 00000100:00080000:0.0:1787582660.692646:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1787582660.737070:0:6722:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787582660.737098:0:6722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892df800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1874416186174464:0@lo:7: 00000100:00100000:3.0:1787582660.737409:0:6722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582660.737456:0:6722:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf702780 going to sleep for 11 seconds 00000004:00080000:3.0:1787582660.737474:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787582660.737508:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186174336:0@lo:13: 00000100:00100000:3.0:1787582660.737533:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582660.737579:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186174336 00000100:00100000:3.0:1787582660.737585:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186174336 00000100:00100000:3.0:1787582660.737687:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787582660.737698:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874416186174336:12345-0@lo:13: 00002000:00000024:3.0:1787582660.737737:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787582660.737778:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874416186174336:12345-0@lo:13: Request processed in 83us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582660.737785:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787582660.737929:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787582660.737956:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5892de680 x1874416186174336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582660.737973:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186174336:0@lo:13: 00000100:00100000:1.0:1787582660.740353:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186174464 00000100:00100000:1.0:1787582660.740378:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186174464 00000100:00100000:1.0:1787582660.740431:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787582660.740441:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6722:x1874416186174464:12345-0@lo:7: 00002000:00080000:1.0:1787582660.750897:0:6704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1787582660.750906:0:6704:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787582660.751003:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6722:x1874416186174464:12345-0@lo:7: Request processed in 10560us (13591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582660.751014:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787582660.751203:0:6722:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5892df800 x1874416186174464/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787582676 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582660.751219:0:6722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892df800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1874416186174464:0@lo:7: 00000004:00080000:2.0:1787582660.751231:0:6722:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787582660.751268:0:6722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1874416186174592:0@lo:5: 00000100:00100000:2.0:1787582660.751302:0:6722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582660.751356:0:6722:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5884bf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582660.752022:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186174592 00000100:00100000:1.0:1787582660.752090:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186174592 00000100:00100000:1.0:1787582660.752184:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787582660.752193:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6722:x1874416186174592:12345-0@lo:5: 00002000:00080000:1.0:1787582660.752216:0:6703:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787582660.752219:0:6703:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787582660.755266:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6722:x1874416186174592:12345-0@lo:5: Request processed in 3067us (3956us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787582660.755278:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787582660.755282:0:6722:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5855c0a80 x1874416186174592/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787582676 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582660.755299:0:6722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1874416186174592:0@lo:5: 00000004:00080000:2.0:1787582660.755313:0:6722:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787582660.755375:0:6722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1874416186174720:0@lo:700: 00000100:00100000:2.0:1787582660.755409:0:6722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582660.755597:0:6722:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5884bf3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582660.759817:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186174720 00000100:00100000:1.0:1787582660.759830:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186174720 00000100:00100000:1.0:1787582660.759885:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582660.759896:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6722:x1874416186174720:12345-0@lo:700: 00000100:00100000:1.0:1787582660.759947:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6711:1874416186174848:0@lo:700: 00000100:00100000:1.0:1787582660.760003:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582660.760036:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5830c8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787582660.760282:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186174848 00000100:00100000:2.0:1787582660.760288:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186174848 00000100:00100000:2.0:1787582660.760341:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787582660.760350:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6711:x1874416186174848:12345-0@lo:700: 40000000:02000000:2.0:1787582660.809230:0:5860:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787582660.817901:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6711:x1874416186174848:12345-0@lo:700: Request processed in 57545us (57889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582660.817914:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787582660.817984:0:6711:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5b4fa0700 x1874416186174848/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787582676 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582660.817998:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6711:1874416186174848:0@lo:700: 40000000:02000000:2.0:1787582660.818011:0:6711:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1787582660.913529:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6722:x1874416186174720:12345-0@lo:700: Request processed in 153628us (158111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582660.913547:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787582660.913677:0:6722:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5855c0380 x1874416186174720/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787582676 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582660.913692:0:6722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1874416186174720:0@lo:700: 00000001:00080000:2.0:1787582660.915645:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1787582660.915663:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:3.0:1787582660.954550:0:6722:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787582660.964015:0:6722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892de680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1874416186174976:0@lo:5: 00000100:00100000:3.0:1787582660.964070:0:6722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582660.964113:0:6722:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf7020c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582660.964780:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186174976 00000100:00100000:2.0:1787582660.964787:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186174976 00000100:00100000:2.0:1787582660.964834:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787582660.964842:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6722:x1874416186174976:12345-0@lo:5: 00002000:00080000:1.0:1787582660.979008:0:6704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787582660.979032:0:6704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787582660.986650:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6722:x1874416186174976:12345-0@lo:5: Request processed in 21800us (22570us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787582660.986662:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787582660.986988:0:6722:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5892de680 x1874416186174976/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787582676 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582660.987002:0:6722:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787582660.987016:0:6722:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8da5892de680 x1874416186174976/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787582676 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582660.987026:0:6722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892de680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1874416186174976:0@lo:5: 00000004:00080000:3.0:1787582660.987039:0:6722:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1787582661.072530:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582662.096467:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787582662.234854:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787582662.234861:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8da584c3b800 from 4 10000000:01000000:1.0:1787582662.234866:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787582662.234906:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582662.234917:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582662.234927:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582662.234950:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186175104:0@lo:101: 00000100:00100000:1.0:1787582662.235010:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582662.236819:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5830c8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787582662.241672:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186175104 00000100:00100000:0.0:1787582662.241685:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186175104 00000100:00100000:1.0:1787582662.242715:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787582662.242726:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:5851:x1874416186175104:12345-0@lo:101: 00010000:00010000:1.0:1787582662.242740:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582662.242758:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da581686400/0xa113d808b7537aed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537ae6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582662.242783:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da581686400/0xa113d808b7537aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537ae6 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582662.242793:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da581686400/0xa113d808b7537aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537ae6 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582662.242801:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da581686400, rc 0) 00000100:00100000:1.0:1787582662.242869:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186175104:12345-0@lo:101: Request processed in 144us (7858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582662.242885:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787582662.242936:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186175104:0@lo:101: 00010000:00010000:1.0:1787582662.242952:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537aed expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582662.242961:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537aed expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582662.243016:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186175232:0@lo:256: 00000100:00100000:1.0:1787582662.243048:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582662.243071:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186175232 00000100:00100000:1.0:1787582662.243075:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186175232 00000100:00100000:1.0:1787582662.243097:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787582662.243104:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186175232:12345-0@lo:256: 20000000:01000000:1.0:1787582662.243116:0:5847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787582662.243130:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787582662.243133:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787582662.243218:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186175232:12345-0@lo:256: Request processed in 114us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582662.243225:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787582662.243252:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5830c8780 going to sleep for 11 seconds 00000100:00100000:1.0:1787582662.243262:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186175232:0@lo:256: 10000000:01000000:1.0:1787582662.244295:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787582662.244304:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537ae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537aed expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582662.244327:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537aed expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:0.0:1787582662.559774:0:7073:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg620-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787582663.122177:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582664.157833:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582665.168551:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582665.808536:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186175360:0@lo:13: 00000100:00100000:2.0:1787582665.808606:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582665.808777:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186175360 00000100:00100000:3.0:1787582665.808784:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186175360 00000100:00100000:3.0:1787582665.808832:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787582665.808848:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874416186175360:12345-0@lo:13: 00002000:00000024:3.0:1787582665.808880:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582665.808918:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874416186175360:12345-0@lo:13: Request processed in 73us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582665.808925:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787582665.808948:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186175616:0@lo:400: 00000100:00100000:3.0:1787582665.808972:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582665.808992:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787582665.808998:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186175744:0@lo:400: 00000100:00100000:3.0:1787582665.809022:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787582665.809045:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582665.809058:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186175616 00000100:00100000:3.0:1787582665.809062:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186175616 00000100:00100000:3.0:1787582665.809084:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186175744 00000100:00100000:3.0:1787582665.809087:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186175744 00000100:00100000:3.0:1787582665.809104:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787582665.809110:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186175616:12345-0@lo:400: 00000100:00100000:3.0:1787582665.809171:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186175616:12345-0@lo:400: Request processed in 61us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582665.809178:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787582665.809189:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787582665.809196:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186175744:12345-0@lo:400: 00000100:00100000:3.0:1787582665.809220:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186175744:12345-0@lo:400: Request processed in 25us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582665.809226:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787582665.809243:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787582665.809263:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5892dca80 x1874416186175744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582665.809282:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186175744:0@lo:400: 00010000:00080000:3.0:1787582665.809293:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5892dc380 x1874416186175616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582665.809302:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186175616:0@lo:400: 00010000:00080000:2.0:1787582665.809459:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5892ddc00 x1874416186175360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582665.809472:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186175360:0@lo:13: 00000100:00100000:2.0:1787582665.809482:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787582665.809488:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186175488:0@lo:400: 00000100:00100000:2.0:1787582665.809515:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582665.809594:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186175488 00000100:00100000:3.0:1787582665.809598:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186175488 00000100:00100000:3.0:1787582665.809631:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787582665.809638:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+16:3311:x1874416186175488:12345-0@lo:400: 00000100:00100000:3.0:1787582665.809673:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+16:3311:x1874416186175488:12345-0@lo:400: Request processed in 35us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582665.809680:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787582665.809710:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186175488:0@lo:400: 00010000:00010000:2.0:1787582666.195883:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787582666.456995:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787582667.216919:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582668.242857:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582669.265718:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582670.291293:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582670.928671:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186175872:0@lo:400: 00000100:00100000:3.0:1787582670.928673:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186176000:0@lo:400: 00000100:00100000:0.0:1787582670.928781:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582670.928799:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582670.928889:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186176128:0@lo:400: 00000100:00100000:0.0:1787582670.928896:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186175872 00000100:00100000:0.0:1787582670.928907:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186175872 00000100:00100000:3.0:1787582670.928926:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582670.928956:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787582670.928963:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186176256:0@lo:400: 00000100:00100000:0.0:1787582670.928971:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787582670.928983:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:3311:x1874416186175872:12345-0@lo:400: 00000100:00100000:3.0:1787582670.929002:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582670.929059:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186176000 00000100:00100000:0.0:1787582670.929067:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:3311:x1874416186175872:12345-0@lo:400: Request processed in 82us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582670.929069:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186176000 00000100:00100000:0.0:1787582670.929084:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787582670.929136:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186176256 00000100:00100000:3.0:1787582670.929142:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186176256 00000100:00100000:0.0:1787582670.929168:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186175872:0@lo:400: 00000100:00100000:3.0:1787582670.929179:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787582670.929205:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186176000:12345-0@lo:400: 00000100:00100000:3.0:1787582670.929266:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186176000:12345-0@lo:400: Request processed in 63us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582670.929273:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787582670.929289:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787582670.929295:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186176256:12345-0@lo:400: 00010000:00080000:0.0:1787582670.929432:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5892dc380 x1874416186176000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582670.929446:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186176000:0@lo:400: 00000100:00100000:3.0:1787582670.929709:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186176256:12345-0@lo:400: Request processed in 411us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582670.929717:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787582670.929762:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186176128 00000100:00100000:3.0:1787582670.929768:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186176128 00000100:00100000:3.0:1787582670.929823:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787582670.929831:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186176128:12345-0@lo:400: 00000100:00100000:3.0:1787582670.929867:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186176128:12345-0@lo:400: Request processed in 38us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582670.929873:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787582670.929901:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787582670.929907:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787582670.932662:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5892ded80 x1874416186176256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582670.932680:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186176256:0@lo:400: 00010000:00080000:0.0:1787582670.932698:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5892dca80 x1874416186176128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582670.932706:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787582670.932719:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186176128:0@lo:400: 00000100:00100000:0.0:1787582670.934237:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186176384:0@lo:13: 00000100:00100000:0.0:1787582670.934303:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582670.934510:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186176384 00000100:00100000:3.0:1787582670.934528:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186176384 00000100:00100000:3.0:1787582670.934614:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787582670.934631:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186176384:12345-0@lo:13: 00002000:00000024:3.0:1787582670.934684:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582670.935741:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186176384:12345-0@lo:13: Request processed in 1107us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582670.935754:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787582670.939581:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5892df480 x1874416186176384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582670.939611:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186176384:0@lo:13: 00010000:00010000:3.0:1787582671.318079:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582672.339521:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582673.360602:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787582674.039663:0:7636:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787582674.039667:0:7636:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787582674.039771:0:7636:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8da5bb7f0800 00000020:01000004:1.0:1787582674.039786:0:7636:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787582674.039798:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787582674.039810:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8da589c2cd28) 00000020:00000080:1.0:1787582674.039824:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787582674.079203:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787582674.081016:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787582674.125773:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787582674.133136:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787582674.133180:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787582674.133240:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787582674.133272:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787582674.133615:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787582674.133627:0:7636:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787582674.133637:0:7636:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa113d808b7537afb 00000020:01000004:3.0:1787582674.133646:0:7636:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787582674.133665:0:7636:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787582674.133668:0:7636:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787582674.133674:0:7636:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787582674.133693:0:7636:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787582674.133697:0:7636:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787582674.162074:0:7636:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787582674.163041:0:7636:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.120@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787582674.163046:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787582674.163048:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787582674.163050:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582674.163051:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582674.163052:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582674.163053:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582674.163055:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787582674.163056:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787582674.163058:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787582674.163059:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582674.163061:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787582674.163065:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787582674.163067:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787582674.163068:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787582674.163069:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582674.163070:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582674.163071:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582674.163072:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582674.163073:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787582674.163074:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787582674.163151:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787582674.163153:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582674.163161:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787582674.163187:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787582674.163203:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186176512:0@lo:253: 00000100:00100000:2.0:1787582674.163271:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582674.163458:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c23000 going to sleep for 11 seconds 00000100:00100000:1.0:1787582674.163932:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186176512 00000100:00100000:1.0:1787582674.163939:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186176512 00000100:00100000:1.0:1787582674.164024:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787582674.164034:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:7636:x1874416186176512:12345-0@lo:253: 20000000:01000000:1.0:1787582674.164062:0:5848:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787582674.164065:0:5848:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787582674.164070:0:5848:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787582674.164073:0:5848:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787582674.170900:0:5848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787582674.171669:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787582674.171688:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787582674.171734:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787582674.171743:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787582674.171775:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787582674.171828:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787582674.172233:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787582674.172254:0:5848:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.120@tcp 20000000:01000000:1.0:1787582674.172256:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.120@tcp (null) (null) (null) 00000040:00080000:1.0:1787582674.172294:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787582674.172303:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787582674.172391:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787582674.172401:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.120@tcp (null) (null) 00000040:00080000:1.0:1787582674.172433:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787582674.172443:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787582674.172479:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787582674.172756:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787582674.173939:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787582674.173961:0:5848:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.120@tcp 20000000:01000000:1.0:1787582674.173962:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.120@tcp (null) (null) (null) 00000040:00080000:1.0:1787582674.173997:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787582674.174005:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787582674.174035:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787582674.174043:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.120@tcp (null) (null) 00000040:00080000:1.0:1787582674.174071:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787582674.174199:0:5848:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787582674.174255:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787582674.174295:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787582674.174312:0:5848:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787582674.174314:0:5848:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787582674.174451:0:5848:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787582674.174464:0:5848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787582674.174466:0:5848:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787582674.174501:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787582674.174504:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787582674.175440:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787582674.175524:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787582674.175559:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787582674.175865:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787582674.175908:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787582674.175961:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1787582674.175974:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787582674.175976:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787582674.176474:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787582674.176696:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787582674.176736:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787582674.176786:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787582674.176807:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787582674.176809:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787582674.177314:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1787582674.177484:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1787582674.177560:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787582674.177797:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787582674.177832:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787582674.177882:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787582674.177893:0:5848:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787582674.177895:0:5848:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787582674.184304:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787582674.184669:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787582674.184723:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787582674.185033:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1787582674.185092:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1787582674.185137:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1787582674.185154:0:5848:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787582674.185156:0:5848:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787582674.185164:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787582674.185180:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.185196:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da581686800/0xa113d808b7537a29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537a22 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.185204:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da581686c00/0xa113d808b7537a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537a30 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.185210:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da58147e200/0xa113d808b7537a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537a68 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.185216:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5c20ef800/0xa113d808b7537aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537a99 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.185222:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da580030e00/0xa113d808b7537abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537ab5 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.185229:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b02 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.185282:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da580030e00/0xa113d808b7537abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537ab5 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.185297:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da580030e00/0xa113d808b7537abc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537ab5 expref: 16 pid: 5848 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582674.185311:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1874416186176640:0@lo:104: 00000100:00100000:2.0:1787582674.185399:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582674.185506:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5c20ef800/0xa113d808b7537aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537a99 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.185515:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da5c20ef800/0xa113d808b7537aa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537a99 expref: 16 pid: 5848 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582674.185523:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1874416186176768:0@lo:104: 00000100:00100000:2.0:1787582674.185546:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582674.187265:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da58147e200/0xa113d808b7537a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537a68 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.187279:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da58147e200/0xa113d808b7537a6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537a68 expref: 16 pid: 5847 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582674.187291:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1874416186176896:0@lo:104: 00000100:00100000:2.0:1787582674.187340:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582674.187523:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186176640 00000100:00100000:0.0:1787582674.187530:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186176640 00000100:00100000:0.0:1787582674.187576:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186176768 00000100:00100000:0.0:1787582674.187578:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186176768 00000100:00100000:0.0:1787582674.187589:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787582674.187597:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+4:5848:x1874416186176640:12345-0@lo:104: 00010000:00010000:0.0:1787582674.187607:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da581687200/0xa113d808b7537ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537abc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.187656:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787582674.187661:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+4:5848:x1874416186176640:12345-0@lo:104: Request processed in 66us (2264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.187667:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787582674.187682:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787582674.187687:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5848:x1874416186176768:12345-0@lo:104: 00010000:00010000:0.0:1787582674.187693:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee400/0xa113d808b7537a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537aa0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.187721:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787582674.187725:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5848:x1874416186176768:12345-0@lo:104: Request processed in 38us (2179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.187730:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787582674.187745:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787582674.187761:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da581687200/0xa113d808b7537ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537abc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.187767:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581687200 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582674.187771:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da581687200/0xa113d808b7537ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537abc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.187778:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da581687200/0xa113d808b7537ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537abc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582674.187785:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da581687200/0xa113d808b7537ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537abc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582674.187790:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582674.187816:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da581687200/0xa113d808b7537ab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537abc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.187823:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582674.187836:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da581687200/0xa113d808b7537ab5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537abc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.187844:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da581687200/0xa113d808b7537ab5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537abc expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.187855:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582674.187859:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee400/0xa113d808b7537a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537aa0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.187865:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee400 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582674.187868:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee400/0xa113d808b7537a99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537aa0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.187883:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee400/0xa113d808b7537a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537aa0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582674.187889:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee400/0xa113d808b7537a99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537aa0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582674.187894:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582674.187906:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee400/0xa113d808b7537a99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537aa0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.187910:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582674.187922:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee400/0xa113d808b7537a99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537aa0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.187928:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee400/0xa113d808b7537a99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537aa0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.187936:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582674.187937:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582674.187939:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582674.187955:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186177024:0@lo:103: 00000100:00100000:0.0:1787582674.187980:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582674.188013:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186177152:0@lo:103: 00000100:00100000:0.0:1787582674.188030:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582674.188053:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186177024 00000100:00100000:0.0:1787582674.188056:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186177024 00010000:00010000:0.0:1787582674.188070:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da580030e00/0xa113d808b7537abc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537ab5 expref: 17 pid: 5848 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.188166:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582674.188279:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186177152 00000100:00100000:0.0:1787582674.188282:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186177152 00010000:00010000:0.0:1787582674.188295:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5c20ef800/0xa113d808b7537aa0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537a99 expref: 18 pid: 5848 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582674.188308:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787582674.188314:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+18:3312:x1874416186177024:12345-0@lo:103: 00010000:00010000:0.0:1787582674.188342:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582674.188348:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da580030e00/0xa113d808b7537abc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537ab5 expref: 18 pid: 5848 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.188359:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da580030e00/0xa113d808b7537abc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537ab5 expref: 18 pid: 5848 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.188374:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582674.188404:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+18:3312:x1874416186177024:12345-0@lo:103: Request processed in 90us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.188410:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787582674.188424:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787582674.188430:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:3313:x1874416186177152:12345-0@lo:103: 00010000:00010000:0.0:1787582674.188437:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582674.188441:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5c20ef800/0xa113d808b7537aa0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537a99 expref: 17 pid: 5848 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.188449:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5c20ef800/0xa113d808b7537aa0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537a99 expref: 17 pid: 5848 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.188458:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582674.188491:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:3313:x1874416186177152:12345-0@lo:103: Request processed in 60us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.188497:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787582674.188530:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186177024:0@lo:103: 00000100:00100000:0.0:1787582674.188568:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186177152:0@lo:103: 00000100:00100000:0.0:1787582674.192970:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186176896 00000100:00100000:0.0:1787582674.192982:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186176896 00000100:00100000:0.0:1787582674.193026:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787582674.193034:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5848:x1874416186176896:12345-0@lo:104: 00010000:00010000:0.0:1787582674.193050:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da580031a00/0xa113d808b7537a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537a6f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.193138:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787582674.193143:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5848:x1874416186176896:12345-0@lo:104: Request processed in 110us (5803us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.193149:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787582674.193352:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da581686c00/0xa113d808b7537a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537a30 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.193365:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da581686c00/0xa113d808b7537a37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537a30 expref: 16 pid: 5846 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582674.193378:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1874416186177280:0@lo:104: 00000100:00100000:1.0:1787582674.193413:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787582674.193439:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da581686800/0xa113d808b7537a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537a22 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.193449:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da581686800/0xa113d808b7537a29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537a22 expref: 16 pid: 5846 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582674.193457:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1874416186177408:0@lo:104: 00000100:00100000:1.0:1787582674.193477:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582674.193488:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c23600 going to sleep for 11 seconds 00010000:00010000:1.0:1787582674.193508:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da580030e00/0xa113d808b7537abc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537ab5 expref: 16 pid: 5848 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582674.193521:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1874416186176640:0@lo:104: 00010000:00010000:1.0:1787582674.193554:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5c20ef800/0xa113d808b7537aa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537a99 expref: 15 pid: 5848 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582674.193583:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1874416186176768:0@lo:104: 00000100:00100000:1.0:1787582674.193594:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1874416186176896:0@lo:104: 00010000:00010000:2.0:1787582674.193893:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582674.193900:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da580031a00/0xa113d808b7537a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537a6f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.193919:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580031a00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1787582674.193930:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da580031a00/0xa113d808b7537a68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537a6f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.193939:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da580031a00/0xa113d808b7537a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537a6f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582674.193946:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da580031a00/0xa113d808b7537a68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537a6f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582674.193952:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787582674.194001:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da580031a00/0xa113d808b7537a68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537a6f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.194008:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582674.194023:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da580031a00/0xa113d808b7537a68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537a6f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.194030:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da580031a00/0xa113d808b7537a68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537a6f expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.194043:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582674.194045:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582674.194046:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582674.194210:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186177536:0@lo:103: 00000100:00100000:0.0:1787582674.194242:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582674.194289:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186177280 00000100:00100000:0.0:1787582674.194293:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186177280 00000100:00100000:0.0:1787582674.194312:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186177408 00000100:00100000:0.0:1787582674.194334:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186177408 00000100:00100000:0.0:1787582674.194355:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787582674.194362:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+4:5848:x1874416186177280:12345-0@lo:104: 00010000:00010000:0.0:1787582674.194371:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537a30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537a37 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.194420:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787582674.194432:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+4:5848:x1874416186177280:12345-0@lo:104: Request processed in 70us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.194438:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787582674.194453:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787582674.194458:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5848:x1874416186177408:12345-0@lo:104: 00010000:00010000:0.0:1787582674.194466:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da581687a00/0xa113d808b7537a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.194500:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787582674.194505:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5848:x1874416186177408:12345-0@lo:104: Request processed in 48us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.194511:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1787582674.194647:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787582674.194652:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537a30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537a37 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.194658:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581687000 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582674.194661:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537a30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537a37 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.194669:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537a37 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582674.194676:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537a37 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582674.194680:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582674.194696:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537a30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537a37 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.194712:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582674.194739:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537a30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537a37 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.194745:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537a30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537a37 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.194756:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582674.194758:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da581687a00/0xa113d808b7537a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.194763:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581687a00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582674.194766:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da581687a00/0xa113d808b7537a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.194772:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da581687a00/0xa113d808b7537a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582674.194778:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da581687a00/0xa113d808b7537a22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582674.194783:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582674.194795:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da581687a00/0xa113d808b7537a22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.194801:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582674.194805:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da581687a00/0xa113d808b7537a22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.194810:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da581687a00/0xa113d808b7537a22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537a29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.194832:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582674.194833:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582674.194835:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582674.194845:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186177792:0@lo:103: 00000100:00100000:0.0:1787582674.194870:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582674.194896:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787582674.194902:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186177664:0@lo:103: 00000100:00100000:0.0:1787582674.194934:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582674.194961:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186177536 00000100:00100000:0.0:1787582674.194965:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186177536 00010000:00010000:0.0:1787582674.194981:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da58147e200/0xa113d808b7537a6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537a68 expref: 15 pid: 5847 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582674.194994:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186177792 00000100:00100000:0.0:1787582674.194997:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186177792 00010000:00010000:0.0:1787582674.195006:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da581686800/0xa113d808b7537a29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537a22 expref: 16 pid: 5846 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582674.195014:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186177664 00000100:00100000:0.0:1787582674.195016:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186177664 00010000:00010000:0.0:1787582674.195024:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da581686c00/0xa113d808b7537a37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537a30 expref: 17 pid: 5846 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582674.195035:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787582674.195040:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:3314:x1874416186177536:12345-0@lo:103: 00010000:00010000:0.0:1787582674.195050:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582674.195054:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da58147e200/0xa113d808b7537a6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537a68 expref: 17 pid: 5847 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195215:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da58147e200/0xa113d808b7537a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537a68 expref: 17 pid: 5847 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195230:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da58147e200/0xa113d808b7537a6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537a68 expref: 17 pid: 5847 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195245:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582674.195278:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:3314:x1874416186177536:12345-0@lo:103: Request processed in 238us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.195284:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787582674.195298:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787582674.195304:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:3312:x1874416186177792:12345-0@lo:103: 00010000:00010000:0.0:1787582674.195311:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582674.195337:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da581686800/0xa113d808b7537a29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537a22 expref: 15 pid: 5846 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195346:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da581686800/0xa113d808b7537a29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537a22 expref: 15 pid: 5846 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195560:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582674.195590:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:3312:x1874416186177792:12345-0@lo:103: Request processed in 286us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.195597:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787582674.195610:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787582674.195616:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:3312:x1874416186177664:12345-0@lo:103: 00010000:00010000:0.0:1787582674.195623:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582674.195628:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da581686c00/0xa113d808b7537a37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537a30 expref: 14 pid: 5846 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195642:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da581686c00/0xa113d808b7537a37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537a30 expref: 14 pid: 5846 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195653:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b02 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195660:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b02 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195673:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195679:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195685:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b02 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195692:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195698:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147ec00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582674.195701:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195708:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b02 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195716:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b02 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.195735:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582674.195759:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:3312:x1874416186177664:12345-0@lo:103: Request processed in 144us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.195765:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787582674.195787:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582674.195811:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186177536:0@lo:103: 00000100:00100000:0.0:1787582674.195836:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186177664:0@lo:103: 00000100:00100000:0.0:1787582674.195843:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186177792:0@lo:103: 00010000:00010000:0.0:1787582674.196226:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da581686c00/0xa113d808b7537a37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537a30 expref: 13 pid: 5846 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582674.196236:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1874416186177280:0@lo:104: 00010000:00010000:0.0:1787582674.196244:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da581686800/0xa113d808b7537a29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537a22 expref: 12 pid: 5846 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582674.196250:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa3100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5848:1874416186177408:0@lo:104: 00010000:00010000:0.0:1787582674.196271:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.196280:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.196286:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.196292:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b02 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787582674.196340:0:5848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787582674.292309:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+11:7636:x1874416186176512:12345-0@lo:253: Request processed in 128269us (129030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582674.292350:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787582674.294239:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186176512:0@lo:253: 10000000:01000000:1.0:1787582674.294258:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787582674.294261:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787582674.294262:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787582674.294264:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787582674.294265:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787582674.294266:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787582674.294267:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787582674.294269:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787582674.294270:0:7636:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787582674.294272:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787582674.294273:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787582674.294295:0:7636:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8da5bb7f0800 from lustre-OST0001 10000000:01000000:1.0:1787582674.294343:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787582674.294346:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787582674.294355:0:7636:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8da588590000 local copy 10000000:01000000:1.0:1787582674.294359:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787582674.294394:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.294405:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.294415:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582674.294434:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186177920:0@lo:101: 00000100:00100000:1.0:1787582674.294502:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582674.294577:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5830c8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787582674.294699:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186177920 00000100:00100000:0.0:1787582674.294706:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186177920 00000100:00100000:0.0:1787582674.294754:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787582674.294764:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+11:7636:x1874416186177920:12345-0@lo:101: 00010000:00010000:0.0:1787582674.294776:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582674.294789:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da580031800/0xa113d808b7537b10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537b09 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.294811:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da580031800/0xa113d808b7537b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537b09 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.294821:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da580031800/0xa113d808b7537b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537b09 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.294829:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580031800, rc 0) 00000100:00100000:0.0:1787582674.294872:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+12:7636:x1874416186177920:12345-0@lo:101: Request processed in 109us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.294878:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787582674.295098:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186177920:0@lo:101: 00010000:00010000:1.0:1787582674.295121:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa113d808b7537b10 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.295130:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa113d808b7537b10 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582674.295221:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186178048:0@lo:501: 00000100:00100000:1.0:1787582674.295247:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582674.295269:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5830c8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582674.295384:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186178048 00000100:00100000:2.0:1787582674.295388:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186178048 00000100:00100000:2.0:1787582674.295419:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787582674.295426:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589263c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+12:7636:x1874416186178048:12345-0@lo:501: 00000100:00100000:2.0:1787582674.295628:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589263c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+12:7636:x1874416186178048:12345-0@lo:501: Request processed in 202us (379us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787582674.295642:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787582674.295714:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186178048:0@lo:501: 10000000:01000000:1.0:1787582674.295726:0:7636:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787582674.295751:0:7636:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787582674.295756:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa113d808b7537b10 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.295763:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa113d808b7537b10 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.295770:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa113d808b7537b10 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.297786:0:7636:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787582674.297826:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8da5bb7f0800 10000000:01000000:1.0:1787582674.297835:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787582674.297842:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787582674.297844:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787582674.297848:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787582674.297863:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787582674.297896:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686800/0xa113d808b7537b17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.297906:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da581686800/0xa113d808b7537b17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.297917:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da581686800/0xa113d808b7537b17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582674.297937:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186178176:0@lo:101: 00000100:00100000:1.0:1787582674.297991:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582674.298036:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5830c83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582674.302353:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186178176 00000100:00100000:3.0:1787582674.302368:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186178176 00000100:00100000:3.0:1787582674.302436:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787582674.302447:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+12:7636:x1874416186178176:12345-0@lo:101: 00010000:00010000:3.0:1787582674.302478:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582674.302496:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5c20ee000/0xa113d808b7537b1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537b17 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582674.302524:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5c20ee000/0xa113d808b7537b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537b17 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582674.302535:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5c20ee000/0xa113d808b7537b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537b17 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582674.302545:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ee000, rc 0) 00000100:00100000:3.0:1787582674.302627:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186178176:12345-0@lo:101: Request processed in 182us (4634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582674.302633:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787582674.303205:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186178176:0@lo:101: 00010000:00010000:1.0:1787582674.303224:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da581686800/0xa113d808b7537b17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b1e expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.303234:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da581686800/0xa113d808b7537b17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537b1e expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582674.303379:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186178304:0@lo:501: 00000100:00100000:1.0:1787582674.303417:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582674.303442:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5830c83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582674.303503:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186178304 00000100:00100000:0.0:1787582674.303509:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186178304 00000100:00100000:0.0:1787582674.303546:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787582674.303555:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186178304:12345-0@lo:501: 00000100:00100000:0.0:1787582674.303784:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186178304:12345-0@lo:501: Request processed in 229us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.303791:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787582674.304210:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186178304:0@lo:501: 00000100:00100000:1.0:1787582674.304242:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186178432:0@lo:503: 00000100:00100000:1.0:1787582674.304287:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582674.304310:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5830c83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582674.304441:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186178432 00000100:00100000:0.0:1787582674.304452:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186178432 00000100:00100000:0.0:1787582674.304487:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787582674.304495:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589263050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186178432:12345-0@lo:503: 00000100:00100000:0.0:1787582674.304652:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589263050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186178432:12345-0@lo:503: Request processed in 157us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.304659:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787582674.304778:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186178432:0@lo:503: 00000040:00080000:1.0:1787582674.305111:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787582674.305191:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186178560:0@lo:502: 00000100:00100000:1.0:1787582674.305227:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582674.305261:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58a9a86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582674.305385:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186178560 00000100:00100000:3.0:1787582674.305390:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186178560 00000100:00100000:3.0:1787582674.305427:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787582674.305435:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186178560:12345-0@lo:502: 00000100:00100000:3.0:1787582674.305582:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186178560:12345-0@lo:502: Request processed in 148us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582674.305589:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787582674.306193:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186178560:0@lo:502: 00010000:00010000:2.0:1787582674.307985:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582674.307997:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa113d808b7537b10 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.308008:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581686600 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1787582674.308012:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa113d808b7537b10 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.308022:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa113d808b7537b10 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582674.308030:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa113d808b7537b10 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582674.308035:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787582674.308267:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa113d808b7537b10 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582674.308275:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000040:00080000:0.0:1787582674.310813:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000100:00100000:2.0:1787582674.310890:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186178688:0@lo:103: 00000040:00080000:0.0:1787582674.310934:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000100:00100000:2.0:1787582674.310962:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582674.311087:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186178688 00000100:00100000:1.0:1787582674.311096:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186178688 00000100:00100000:1.0:1787582674.311186:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582674.311197:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:3313:x1874416186178688:12345-0@lo:103: 00010000:00010000:1.0:1787582674.311212:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582674.311231:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da580031800/0xa113d808b7537b10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa113d808b7537b09 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.311248:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582674.311285:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+12:3313:x1874416186178688:12345-0@lo:103: Request processed in 91us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582674.311293:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:0.0:1787582674.311362:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787582674.311432:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787582674.311542:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787582674.311578:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787582674.311611:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186178816:0@lo:502: 00000100:00100000:0.0:1787582674.311666:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582674.311702:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b618d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787582674.313778:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186178688:0@lo:103: 00000100:00100000:1.0:1787582674.313911:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186178816 00000100:00100000:1.0:1787582674.313918:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186178816 00000100:00100000:1.0:1787582674.313960:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787582674.313968:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+12:7636:x1874416186178816:12345-0@lo:502: 00000100:00100000:1.0:1787582674.314238:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+12:7636:x1874416186178816:12345-0@lo:502: Request processed in 269us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582674.314245:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787582674.314359:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186178816:0@lo:502: 00000040:00080000:2.0:1787582674.314489:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787582674.314508:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787582674.315300:0:7645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787582674.315309:0:7645:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787582674.315338:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582674.315340:0:7645:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787582674.315347:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787582674.315360:0:7645:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8da5b5020000) 00000020:00000080:2.0:1787582674.315386:0:7645:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787582674.315393:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787582674.315458:0:7645:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8da5bb7f0800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787582674.315465:0:7645:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787582674.315471:0:7645:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa113d808b7537b2c 00010000:00010000:3.0:1787582674.318443:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa113d808b7537b10 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582674.318460:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa113d808b7537b10 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582674.318485:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582674.318487:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582674.318489:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582674.323039:0:7645:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787582674.323645:0:7645:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787582674.331006:0:7645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787582674.331296:0:7645:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787582674.337907:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787582674.338823:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1787582674.342908:0:7645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787582674.342918:0:7645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582674.342923:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582674.342925:0:7645:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787582674.342928:0:7645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582674.342932:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582674.342933:0:7645:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787582674.342936:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787582674.342937:0:7645:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787582674.342989:0:7645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582674.342991:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582674.342992:0:7645:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787582674.342995:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787582674.344944:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787582674.344984:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787582674.345009:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686800/0xa113d808b7537b17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b1e expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.345028:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da581686800/0xa113d808b7537b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b1e expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582674.345037:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da5bb7f0800 from 1 10000000:01000000:1.0:1787582674.345039:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787582674.345072:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686c00/0xa113d808b7537b33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.345093:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da581686c00/0xa113d808b7537b33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.345114:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da581686c00/0xa113d808b7537b33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582674.345139:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186178944:0@lo:101: 00000100:00100000:1.0:1787582674.345199:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582674.345242:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58a9a86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582674.353401:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186178944 00000100:00100000:0.0:1787582674.353417:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186178944 00000100:00100000:0.0:1787582674.353481:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787582674.353491:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+12:7636:x1874416186178944:12345-0@lo:101: 00010000:00010000:0.0:1787582674.353506:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582674.353523:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da580031e00/0xa113d808b7537b3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537b33 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.353548:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da580031e00/0xa113d808b7537b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537b33 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.353558:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da580031e00/0xa113d808b7537b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537b33 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.353566:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580031e00, rc 0) 00000100:00100000:0.0:1787582674.353657:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186178944:12345-0@lo:101: Request processed in 167us (8457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.353664:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787582674.353717:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186178944:0@lo:101: 00010000:00010000:0.0:1787582674.353733:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da581686c00/0xa113d808b7537b33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b3a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582674.353742:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da581686c00/0xa113d808b7537b33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537b3a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582674.353850:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179072:0@lo:501: 00000100:00100000:0.0:1787582674.353884:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582674.353914:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b618d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787582674.353988:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186179072 00000100:00100000:1.0:1787582674.353992:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186179072 00000100:00100000:1.0:1787582674.354027:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787582674.354035:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186179072:12345-0@lo:501: 00000100:00100000:1.0:1787582674.354273:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186179072:12345-0@lo:501: Request processed in 238us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582674.354281:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787582674.355291:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179072:0@lo:501: 00000100:00100000:0.0:1787582674.355360:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179200:0@lo:503: 00000100:00100000:0.0:1787582674.355409:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582674.355448:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b618d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787582674.356290:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186179200 00000100:00100000:1.0:1787582674.356298:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186179200 00000100:00100000:1.0:1787582674.356374:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787582674.356383:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186179200:12345-0@lo:503: 00000100:00100000:1.0:1787582674.356757:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186179200:12345-0@lo:503: Request processed in 375us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582674.356764:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787582674.362521:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179200:0@lo:503: 00000040:00080000:2.0:1787582674.362847:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787582674.362921:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179328:0@lo:502: 00000100:00100000:2.0:1787582674.362991:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582674.363021:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c233c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582674.363114:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186179328 00000100:00100000:0.0:1787582674.363121:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186179328 00000100:00100000:0.0:1787582674.363171:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787582674.363180:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186179328:12345-0@lo:502: 00000100:00100000:0.0:1787582674.363419:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186179328:12345-0@lo:502: Request processed in 239us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.363426:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787582674.364985:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179328:0@lo:502: 00000040:00080000:2.0:1787582674.365302:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787582674.365381:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787582674.365418:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179456:0@lo:502: 00000100:00100000:2.0:1787582674.365489:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582674.365518:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c233c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582674.366381:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186179456 00000100:00100000:0.0:1787582674.366390:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186179456 00000100:00100000:0.0:1787582674.366452:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787582674.366469:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186179456:12345-0@lo:502: 00000100:00100000:0.0:1787582674.366663:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186179456:12345-0@lo:502: Request processed in 196us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.366672:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787582674.367203:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179456:0@lo:502: 00000040:00080000:2.0:1787582674.367345:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787582674.367362:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787582674.369738:0:7649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582674.369750:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582674.369753:0:7649:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787582674.369760:0:7649:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8da5bb7f0800 00000020:00000080:1.0:1787582674.369762:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787582674.369784:0:7649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582674.369787:0:7649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582674.369789:0:7649:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787582674.369792:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787582674.369969:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787582674.369991:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787582674.370008:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686c00/0xa113d808b7537b33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b3a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.370018:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da581686c00/0xa113d808b7537b33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b3a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582674.370054:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787582674.370057:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8da5bb7f0800 10000000:01000000:2.0:1787582674.370061:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8da5bb7f0800 10000000:01000000:2.0:1787582674.370065:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787582674.370070:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8da5bb7f0800 from 1 10000000:01000000:2.0:1787582674.370072:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787582674.370128:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da58147fc00/0xa113d808b7537b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.370138:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da58147fc00/0xa113d808b7537b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.370149:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da58147fc00/0xa113d808b7537b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582674.370170:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179584:0@lo:101: 00000100:00100000:2.0:1787582674.370229:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582674.370266:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c23300 going to sleep for 11 seconds 00000100:00100000:2.0:1787582674.370286:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186179584 00000100:00100000:2.0:1787582674.370293:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186179584 00000100:00100000:2.0:1787582674.370356:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787582674.370365:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186179584:12345-0@lo:101: 00010000:00010000:2.0:1787582674.370377:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582674.370388:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537b41 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.370409:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537b41 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.370432:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537b41 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.370442:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147ec00, rc 0) 00000100:00100000:2.0:1787582674.370477:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:7636:x1874416186179584:12345-0@lo:101: Request processed in 114us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582674.370483:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787582674.370526:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179584:0@lo:101: 00010000:00010000:2.0:1787582674.370539:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da58147fc00/0xa113d808b7537b41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b48 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582674.370546:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da58147fc00/0xa113d808b7537b41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537b48 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582674.370638:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179712:0@lo:501: 00000100:00100000:2.0:1787582674.370663:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582674.370679:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c23300 going to sleep for 11 seconds 00000100:00100000:2.0:1787582674.370693:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186179712 00000100:00100000:2.0:1787582674.370696:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186179712 00000100:00100000:2.0:1787582674.370719:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787582674.370732:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:7636:x1874416186179712:12345-0@lo:501: 00000100:00100000:2.0:1787582674.370938:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:7636:x1874416186179712:12345-0@lo:501: Request processed in 206us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582674.370945:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787582674.370979:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179712:0@lo:501: 00000100:00100000:2.0:1787582674.371003:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179840:0@lo:503: 00000100:00100000:2.0:1787582674.371040:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582674.371054:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c23300 going to sleep for 11 seconds 00000100:00100000:2.0:1787582674.371066:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186179840 00000100:00100000:2.0:1787582674.371070:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186179840 00000100:00100000:2.0:1787582674.371091:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787582674.371097:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:7636:x1874416186179840:12345-0@lo:503: 00000100:00100000:2.0:1787582674.371238:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:7636:x1874416186179840:12345-0@lo:503: Request processed in 140us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582674.371244:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787582674.371284:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179840:0@lo:503: 00000040:00080000:2.0:1787582674.371542:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787582674.371588:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179968:0@lo:502: 00000100:00100000:2.0:1787582674.371623:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582674.371638:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c23300 going to sleep for 11 seconds 00000100:00100000:2.0:1787582674.371650:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186179968 00000100:00100000:2.0:1787582674.371653:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186179968 00000100:00100000:2.0:1787582674.371675:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787582674.371681:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:7636:x1874416186179968:12345-0@lo:502: 00000100:00100000:2.0:1787582674.371823:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:7636:x1874416186179968:12345-0@lo:502: Request processed in 142us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582674.371839:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787582674.371878:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186179968:0@lo:502: 00000040:00080000:2.0:1787582674.372129:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787582674.372178:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787582674.372215:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787582674.372263:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787582674.372301:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787582674.372374:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787582674.372411:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787582674.372438:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787582674.372477:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787582674.372506:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787582674.372536:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787582674.372582:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787582674.372618:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787582674.372650:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787582674.372707:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787582674.372747:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787582674.372783:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787582674.379602:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787582674.379683:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787582674.379724:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787582674.379798:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787582674.379838:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787582674.379870:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787582674.379914:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787582674.379955:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787582674.379991:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787582674.380038:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787582674.380676:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787582674.380736:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787582674.380819:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787582674.380859:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787582674.380891:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787582674.380923:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787582674.380968:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787582674.381005:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787582674.381058:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787582674.381200:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787582674.381251:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186180096:0@lo:502: 00000100:00100000:2.0:1787582674.381399:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582674.381532:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c23300 going to sleep for 11 seconds 00000100:00100000:3.0:1787582674.384676:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186180096 00000100:00100000:3.0:1787582674.384689:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186180096 00000100:00100000:0.0:1787582674.384821:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787582674.384833:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:7636:x1874416186180096:12345-0@lo:502: 00000100:00100000:0.0:1787582674.385241:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:7636:x1874416186180096:12345-0@lo:502: Request processed in 409us (3841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.385250:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787582674.385887:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186180096:0@lo:502: 00000040:00080000:2.0:1787582674.386016:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787582674.386037:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00010000:00010000:0.0:1787582674.387055:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787582674.387281:0:7650:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787582674.387294:0:7650:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8da5b5024d28) 00000020:00000080:2.0:1787582674.387314:0:7650:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787582674.387732:0:7650:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8da5bb7f0800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787582674.387738:0:7650:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8da5bb7f0800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787582674.387740:0:7650:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8da5bb7f0800 3 00010000:00080000:0.0:1787582674.387768:0:7650:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8da58df1e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.120@tcp at head 00010000:00010000:1.0:1787582674.392944:0:7650:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787582674.393387:0:7650:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787582674.393765:0:7650:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787582674.393777:0:7650:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa113d808b7537b56 00000100:00080000:1.0:1787582674.393787:0:7650:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787582674.393792:0:7650:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8da58df1e000 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:1.0:1787582674.393826:0:7650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5b4fa1180 x1874416186180224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787582674.393885:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874416186180224:0@lo:38: 00000100:00100000:2.0:1787582674.393952:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582674.394052:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186180224 00000100:00100000:3.0:1787582674.394059:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186180224 00000100:00100000:3.0:1787582674.394115:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787582674.394122:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874416186180224:12345-0@lo:38: 00010000:00080000:3.0:1787582674.394144:0:5855:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:3.0:1787582674.394172:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa113d808b7537b5d 00000004:00100000:3.0:1787582674.394186:0:5855:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787582674.394215:0:5855:0:(import.c:65:import_set_state_nolock()) ffff8da5ad760000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1787582674.395284:0:7650:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787582674.395854:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186180352:0@lo:400: 00000100:00100000:0.0:1787582674.395902:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582674.395950:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186180480:0@lo:400: 00000100:00100000:0.0:1787582674.395976:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582674.395996:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787582674.396002:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186180608:0@lo:400: 00000100:00100000:0.0:1787582674.396023:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582674.396047:0:5854:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787582674.396053:0:5854:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787582674.396073:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186180480 00000100:00100000:0.0:1787582674.396078:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186180480 00000100:00100000:0.0:1787582674.396141:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787582674.396150:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186180480:12345-0@lo:400: 00000100:00100000:0.0:1787582674.396212:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186180480:12345-0@lo:400: Request processed in 62us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.396219:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787582674.396254:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787582674.396341:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adbcd880 x1874416186180480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582674.396355:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186180480:0@lo:400: 00000100:00100000:0.0:1787582674.396390:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186180352 00000100:00100000:0.0:1787582674.396394:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186180352 00000100:00100000:0.0:1787582674.396411:0:5854:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787582674.396416:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186180608 00000100:00100000:0.0:1787582674.396418:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186180608 00000100:00100000:0.0:1787582674.396436:0:5854:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787582674.396442:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787582674.396448:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186180352:12345-0@lo:400: 00000100:00100000:0.0:1787582674.396483:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186180352:12345-0@lo:400: Request processed in 36us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.396489:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787582674.396499:0:5854:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787582674.396505:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787582674.396511:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186180608:12345-0@lo:400: 00000100:00100000:0.0:1787582674.396541:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186180608:12345-0@lo:400: Request processed in 30us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582674.396547:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787582674.396560:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787582674.396576:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adbce680 x1874416186180352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582674.396597:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186180352:0@lo:400: 00010000:00080000:0.0:1787582674.396621:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adbcc000 x1874416186180608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582674.396630:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186180608:0@lo:400: 00000100:00100000:3.0:1787582674.398805:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874416186180224:12345-0@lo:38: Request processed in 4675us (4845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582674.398818:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787582674.398952:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5b4fa1180 x1874416186180224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787582684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582674.398964:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787582674.398973:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787582674.398981:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787582674.398985:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787582674.398988:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da58df1e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787582674.398995:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874416186180224:0@lo:38: 00000040:00080000:0.0:1787582674.399268:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1787582674.399442:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787582674.399468:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787582674.399490:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da58147fc00/0xa113d808b7537b41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b48 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582674.399515:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da58147fc00/0xa113d808b7537b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b48 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787582674.399557:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787582674.399559:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787582674.399560:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582674.399561:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582674.399563:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582674.399564:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582674.399566:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787582674.399567:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787582674.399569:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787582674.399570:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582674.399572:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787582674.399576:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787582674.399578:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787582674.399580:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787582674.399581:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582674.399582:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582674.399583:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582674.399584:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582674.399585:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787582674.399586:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787582674.399587:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787582674.399589:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582674.399590:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787582674.399610:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787582674.399624:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186180736:0@lo:253: 00000100:00100000:3.0:1787582674.399681:0:7636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582674.399707:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5857ce900 going to sleep for 11 seconds 00000100:00100000:0.0:1787582674.399810:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186180736 00000100:00100000:0.0:1787582674.399818:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186180736 00000100:00100000:0.0:1787582674.399860:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787582674.399870:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+14:7636:x1874416186180736:12345-0@lo:253: 20000000:01000000:0.0:1787582674.399895:0:5846:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787582674.399908:0:5846:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787582674.400610:0:7651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7651:1874416186180864:0@lo:901: 00000100:00100000:2.0:1787582674.400660:0:7651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582674.400678:0:7651:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c23240 going to sleep for 11 seconds 00000100:00100000:3.0:1787582674.400738:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186180864 00000100:00100000:3.0:1787582674.400743:0:5864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186180864 00000100:00100000:3.0:1787582674.400834:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787582674.400842:0:5864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7651:x1874416186180864:12345-0@lo:901: 00000100:00100000:3.0:1787582674.401164:0:5864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7651:x1874416186180864:12345-0@lo:901: Request processed in 321us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582674.401171:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787582674.408947:0:7651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5855c2a00 x1874416186180864/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787582690 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582674.408966:0:7651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7651:1874416186180864:0@lo:901: 00000100:00080000:0.0:1787582674.409689:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:1.0:1787582674.455785:0:5846:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787582674.455799:0:5846:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1787582674.455828:0:5869:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787582674.455832:0:5869:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787582674.455853:0:5869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8da581687a00/0xa113d808b7537b64 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.455870:0:5869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da581686400/0xa113d808b7537aed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537ae6 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.455895:0:5869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8da581687a00/0xa113d808b7537b64 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.455929:0:5869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da581686400/0xa113d808b7537aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537ae6 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.455944:0:5869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da581686400/0xa113d808b7537aed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537ae6 expref: 14 pid: 5848 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582674.455957:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5869:1874416186180992:0@lo:104: 00000100:00100000:1.0:1787582674.456013:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582674.456055:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58721ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787582674.456072:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186180992 00000100:00100000:1.0:1787582674.456089:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186180992 00000100:00100000:1.0:1787582674.456137:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787582674.456146:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5869:x1874416186180992:12345-0@lo:104: 00010000:00010000:1.0:1787582674.456157:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537aed expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456202:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787582674.456208:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:5869:x1874416186180992:12345-0@lo:104: Request processed in 64us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582674.456214:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787582674.456236:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582674.456241:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537aed expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456248:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581687e00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1787582674.456257:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537aed expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456266:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537aed expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582674.456273:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537aed expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582674.456279:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787582674.456301:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537ae6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537aed expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456307:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582674.456354:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537ae6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537aed expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456361:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537ae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537aed expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456375:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582674.456377:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582674.456379:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582674.456389:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186181120:0@lo:103: 00000100:00100000:1.0:1787582674.456417:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582674.456475:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186181120 00000100:00100000:1.0:1787582674.456479:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186181120 00010000:00010000:1.0:1787582674.456495:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da581686400/0xa113d808b7537aed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537ae6 expref: 15 pid: 5848 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582674.456513:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787582674.456525:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5911ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+15:3313:x1874416186181120:12345-0@lo:103: 00010000:00010000:1.0:1787582674.456534:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582674.456538:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da581686400/0xa113d808b7537aed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537ae6 expref: 15 pid: 5848 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456547:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da581686400/0xa113d808b7537aed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537ae6 expref: 15 pid: 5848 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456559:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8da581687a00/0xa113d808b7537b64 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456565:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da581687a00/0xa113d808b7537b64 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787582674.456575:0:5839:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004892834s 00010000:00010000:1.0:1787582674.456578:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da581687a00/0xa113d808b7537b64 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456584:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da581687a00/0xa113d808b7537b64 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456589:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8da581687a00/0xa113d808b7537b64 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456594:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8da581687a00/0xa113d808b7537b64 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456598:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581687a00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:1.0:1787582674.456601:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8da581687a00/0xa113d808b7537b64 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456607:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8da581687a00/0xa113d808b7537b64 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456619:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8da581687a00/0xa113d808b7537b64 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456627:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582674.456653:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5911ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+15:3313:x1874416186181120:12345-0@lo:103: Request processed in 128us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582674.456659:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787582674.456713:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186181120:0@lo:103: 00010000:00010000:1.0:1787582674.456732:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da581686400/0xa113d808b7537aed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537ae6 expref: 14 pid: 5848 timeout: 365 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582674.456740:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5869:1874416186180992:0@lo:104: 00010000:00010000:1.0:1787582674.456749:0:5869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8da581687a00/0xa113d808b7537b64 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456756:0:5869:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8da581687a00/0xa113d808b7537b64 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456762:0:5869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8da581687a00/0xa113d808b7537b64 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582674.456768:0:5869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da581687a00/0xa113d808b7537b64 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582674.478600:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+13:7636:x1874416186180736:12345-0@lo:253: Request processed in 78724us (78911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582674.478615:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787582674.478722:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:615b3d9a-8a7c-4227-a987-f23a2209c536:7636:1874416186180736:0@lo:253: 10000000:01000000:3.0:1787582674.478737:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787582674.478741:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787582674.478742:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787582674.478744:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582674.478745:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582674.478747:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582674.478748:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582674.478750:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787582674.478751:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787582674.478753:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787582674.478754:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582674.478755:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787582674.478767:0:7636:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787582674.485931:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787582674.486150:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787582674.487710:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787582674.488016:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787582674.488273:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787582674.495237:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787582674.497154:0:7636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787582674.833642:0:7636:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787582674.833650:0:7636:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787582674.833688:0:7636:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787582674.833825:0:7636:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787582674.833839:0:7636:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787582674.833865:0:7636:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787582675.408584:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582676.048982:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787582676.049006:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186181248:0@lo:13: 00000100:00100000:2.0:1787582676.049082:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582676.049248:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186181248 00000100:00100000:3.0:1787582676.049255:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186181248 00000100:00100000:3.0:1787582676.049340:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787582676.049350:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186181248:12345-0@lo:13: 00002000:00000024:3.0:1787582676.049381:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582676.049429:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186181248:12345-0@lo:13: Request processed in 81us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582676.049436:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787582676.049489:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5892de300 x1874416186181248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582692 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582676.049505:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186181248:0@lo:13: 00000100:00080000:2.0:1787582676.049720:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787582676.439030:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582677.466510:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582678.481865:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582679.504944:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582679.638952:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186181504:0@lo:400: 00000100:00100000:3.0:1787582679.639016:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582679.639094:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787582679.639102:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186181376:0@lo:400: 00000100:00100000:3.0:1787582679.639132:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582679.639159:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186181888:0@lo:400: 00000100:00100000:3.0:1787582679.639197:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582679.639222:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186181632:0@lo:400: 00000100:00100000:3.0:1787582679.639247:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582679.639265:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787582679.639270:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186181760:0@lo:400: 00000100:00100000:3.0:1787582679.639291:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582679.639339:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186181504 00000100:00100000:3.0:1787582679.639346:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186181504 00000100:00100000:3.0:1787582679.639386:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186181888 00000100:00100000:3.0:1787582679.639624:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186181888 00000100:00100000:3.0:1787582679.639661:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186181760 00000100:00100000:3.0:1787582679.639665:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186181760 00000100:00100000:3.0:1787582679.639681:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787582679.639690:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186181504:12345-0@lo:400: 00000100:00100000:3.0:1787582679.639743:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186181504:12345-0@lo:400: Request processed in 54us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582679.639750:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787582679.639767:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787582679.639787:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186181888:12345-0@lo:400: 00000100:00100000:3.0:1787582679.639816:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186181888:12345-0@lo:400: Request processed in 31us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582679.639821:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787582679.639833:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787582679.639839:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186181760:12345-0@lo:400: 00000100:00100000:3.0:1787582679.639868:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186181760:12345-0@lo:400: Request processed in 29us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582679.639873:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787582679.639892:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186181632 00000100:00100000:3.0:1787582679.639895:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186181632 00000100:00100000:3.0:1787582679.639923:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787582679.639929:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186181632:12345-0@lo:400: 00000100:00100000:3.0:1787582679.639958:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186181632:12345-0@lo:400: Request processed in 30us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582679.639965:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787582679.639985:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787582679.639990:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787582679.640016:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5892dfb80 x1874416186181760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582679.640031:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186181760:0@lo:400: 00010000:00080000:3.0:1787582679.640042:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5892dd880 x1874416186181632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582679.640051:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186181632:0@lo:400: 00010000:00080000:3.0:1787582679.640100:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5892df480 x1874416186181888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582679.640122:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186181888:0@lo:400: 00010000:00080000:3.0:1787582679.640134:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5892dc000 x1874416186181504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582679.640142:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186181504:0@lo:400: 00000100:00100000:0.0:1787582679.641817:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186181376 00000100:00100000:0.0:1787582679.641829:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186181376 00000100:00100000:0.0:1787582679.641895:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787582679.641905:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:3312:x1874416186181376:12345-0@lo:400: 00000100:00100000:0.0:1787582679.641983:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:3312:x1874416186181376:12345-0@lo:400: Request processed in 81us (2850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582679.641990:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787582679.642115:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186181376:0@lo:400: 00010000:00010000:2.0:1787582680.528790:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582681.168520:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186182016:0@lo:13: 00000100:00100000:0.0:1787582681.168601:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582681.168716:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186182016 00000100:00100000:3.0:1787582681.168725:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186182016 00000100:00100000:3.0:1787582681.168785:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787582681.168795:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186182016:12345-0@lo:13: 00002000:00000024:3.0:1787582681.168827:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582681.168872:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186182016:12345-0@lo:13: Request processed in 78us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582681.168879:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787582681.168948:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787582681.168996:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5892dc000 x1874416186182016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582697 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582681.169016:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186182016:0@lo:13: 00000001:02000400:2.0:1787582681.499481:0:7995:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg620-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787582681.559902:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787582682.193162:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787582682.193170:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8da5a1567000 from 30 10000000:01000000:0.0:1787582682.193176:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787582682.193218:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da580031800/0xa113d808b7537b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582682.193229:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da580031800/0xa113d808b7537b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582682.193252:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da580031800/0xa113d808b7537b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582682.193276:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186182144:0@lo:101: 00000100:00100000:0.0:1787582682.193366:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582682.193417:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58565c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787582682.193582:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186182144 00000100:00100000:1.0:1787582682.193591:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186182144 00000100:00100000:1.0:1787582682.193644:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787582682.193655:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+13:5851:x1874416186182144:12345-0@lo:101: 00010000:00010000:1.0:1787582682.193667:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582682.193682:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da581686400/0xa113d808b7537b72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537b6b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.193703:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da581686400/0xa113d808b7537b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537b6b expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.193713:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da581686400/0xa113d808b7537b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537b6b expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.193722:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da581686400, rc 0) 00000100:00100000:1.0:1787582682.193843:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+14:5851:x1874416186182144:12345-0@lo:101: Request processed in 189us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582682.193850:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787582682.193932:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186182144:0@lo:101: 00010000:00010000:2.0:1787582682.193959:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da580031800/0xa113d808b7537b6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b72 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582682.193969:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da580031800/0xa113d808b7537b6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537b72 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582682.194024:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186182272:0@lo:501: 00000100:00100000:2.0:1787582682.194053:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582682.194095:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787582682.194184:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186182272 00000100:00100000:1.0:1787582682.194189:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186182272 00000100:00100000:1.0:1787582682.194219:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787582682.194226:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:5851:x1874416186182272:12345-0@lo:501: 00000100:00100000:1.0:1787582682.194575:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:5851:x1874416186182272:12345-0@lo:501: Request processed in 348us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582682.194582:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787582682.194895:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186182272:0@lo:501: 00000100:00100000:2.0:1787582682.194926:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186182400:0@lo:503: 00000100:00100000:2.0:1787582682.194971:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582682.194998:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1df00 going to sleep for 11 seconds 00000100:00100000:1.0:1787582682.195856:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186182400 00000100:00100000:1.0:1787582682.195870:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186182400 00000100:00100000:1.0:1787582682.195910:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787582682.195919:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:5851:x1874416186182400:12345-0@lo:503: 00000100:00100000:1.0:1787582682.196448:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:5851:x1874416186182400:12345-0@lo:503: Request processed in 528us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582682.196455:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787582682.201404:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186182400:0@lo:503: 00000100:00100000:2.0:1787582682.201775:0:8030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8030:1874416186182528:0@lo:502: 00000100:00100000:2.0:1787582682.201840:0:8030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582682.201917:0:8030:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582682.205390:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186182528 00000100:00100000:0.0:1787582682.205408:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186182528 00000100:00100000:0.0:1787582682.205474:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787582682.205486:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+14:8030:x1874416186182528:12345-0@lo:502: 00000100:00100000:0.0:1787582682.208176:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+14:8030:x1874416186182528:12345-0@lo:502: Request processed in 2683us (6326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582682.208191:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787582682.213835:0:8030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8030:1874416186182528:0@lo:502: 00000100:00100000:2.0:1787582682.213908:0:8030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8030:1874416186182656:0@lo:502: 00000100:00100000:2.0:1787582682.213971:0:8030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582682.214880:0:8030:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582682.219522:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186182656 00000100:00100000:3.0:1787582682.219538:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186182656 00000100:00100000:3.0:1787582682.219593:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787582682.219604:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:8030:x1874416186182656:12345-0@lo:502: 00000100:00100000:3.0:1787582682.219890:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:8030:x1874416186182656:12345-0@lo:502: Request processed in 287us (5918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582682.219897:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787582682.219971:0:8030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8030:1874416186182656:0@lo:502: 00000040:00080000:3.0:1787582682.220004:0:8030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787582682.220053:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787582682.220086:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787582682.220095:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da580031800/0xa113d808b7537b6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b72 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582682.220110:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da580031800/0xa113d808b7537b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b72 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582682.220118:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787582682.220121:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787582682.220124:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787582682.220150:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5c20ef800/0xa113d808b7537b79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582682.220158:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5c20ef800/0xa113d808b7537b79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582682.220167:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5c20ef800/0xa113d808b7537b79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582682.220184:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186182784:0@lo:101: 00000100:00100000:3.0:1787582682.220218:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582682.221485:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a169b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787582682.221514:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186182784 00000100:00100000:3.0:1787582682.221523:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186182784 00000100:00100000:3.0:1787582682.221588:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787582682.221598:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+14:5851:x1874416186182784:12345-0@lo:101: 00010000:00010000:3.0:1787582682.221612:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582682.221631:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5c20efe00/0xa113d808b7537b80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537b79 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582682.221657:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5c20efe00/0xa113d808b7537b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537b79 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582682.221679:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5c20efe00/0xa113d808b7537b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537b79 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582682.221689:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20efe00, rc 0) 00000100:00100000:3.0:1787582682.221750:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+15:5851:x1874416186182784:12345-0@lo:101: Request processed in 153us (1531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582682.221837:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787582682.221894:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186182784:0@lo:101: 00010000:00010000:3.0:1787582682.221909:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5c20ef800/0xa113d808b7537b79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582682.221919:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5c20ef800/0xa113d808b7537b79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582682.221978:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186182912:0@lo:501: 00000100:00100000:3.0:1787582682.222013:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582682.222030:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a169b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787582682.222041:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186182912 00000100:00100000:3.0:1787582682.222045:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186182912 00000100:00100000:3.0:1787582682.222082:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787582682.222088:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:5851:x1874416186182912:12345-0@lo:501: 00000100:00100000:3.0:1787582682.223536:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:5851:x1874416186182912:12345-0@lo:501: Request processed in 1442us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582682.223546:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787582682.223598:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186182912:0@lo:501: 00000100:00100000:3.0:1787582682.223637:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186183040:0@lo:503: 00000100:00100000:3.0:1787582682.223682:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582682.223707:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a169b000 going to sleep for 11 seconds 00000100:00100000:3.0:1787582682.223720:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186183040 00000100:00100000:3.0:1787582682.223725:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186183040 00000100:00100000:3.0:1787582682.224300:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787582682.224314:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:5851:x1874416186183040:12345-0@lo:503: 00000100:00100000:3.0:1787582682.224648:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:5851:x1874416186183040:12345-0@lo:503: Request processed in 338us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582682.224655:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787582682.224701:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186183040:0@lo:503: 00000100:00100000:3.0:1787582682.230773:0:8034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8034:1874416186183168:0@lo:502: 00000100:00100000:3.0:1787582682.230882:0:8034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582682.230936:0:8034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a169b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787582682.231266:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186183168 00000100:00100000:2.0:1787582682.231274:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186183168 00000100:00100000:2.0:1787582682.231352:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787582682.231362:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:8034:x1874416186183168:12345-0@lo:502: 00000100:00100000:2.0:1787582682.231664:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:8034:x1874416186183168:12345-0@lo:502: Request processed in 303us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582682.231673:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787582682.231918:0:8034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8034:1874416186183168:0@lo:502: 00000020:01000000:3.0:1787582682.231947:0:8034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582682.231956:0:8034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582682.231958:0:8034:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787582682.231962:0:8034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787582682.231964:0:8034:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787582682.231984:0:8034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8034:1874416186183296:0@lo:502: 00000100:00100000:3.0:1787582682.232023:0:8034:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582682.232048:0:8034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a169b540 going to sleep for 11 seconds 00000100:00100000:2.0:1787582682.232144:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186183296 00000100:00100000:2.0:1787582682.232148:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186183296 00000100:00100000:2.0:1787582682.232185:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787582682.232192:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+15:8034:x1874416186183296:12345-0@lo:502: 00000100:00100000:2.0:1787582682.232359:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+15:8034:x1874416186183296:12345-0@lo:502: Request processed in 166us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582682.232365:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787582682.232616:0:8034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8034:1874416186183296:0@lo:502: 00000020:01000000:3.0:1787582682.232636:0:8034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582682.232640:0:8034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582682.232641:0:8034:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787582682.232645:0:8034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1787582682.232840:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787582682.232913:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787582682.232923:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5c20ef800/0xa113d808b7537b79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.232934:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5c20ef800/0xa113d808b7537b79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582682.232942:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787582682.232945:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8da584c3b800 from 30 10000000:01000000:1.0:1787582682.232947:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787582682.232972:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.232980:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.232988:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582682.233001:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186183424:0@lo:101: 00000100:00100000:1.0:1787582682.233033:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582682.233055:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787582682.233196:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186183424 00000100:00100000:3.0:1787582682.233201:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186183424 00000100:00100000:3.0:1787582682.233303:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787582682.233312:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+15:5851:x1874416186183424:12345-0@lo:101: 00010000:00010000:3.0:1787582682.233353:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582682.233364:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5c20ee400/0xa113d808b7537b8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537b87 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582682.233384:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5c20ee400/0xa113d808b7537b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537b87 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582682.233393:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5c20ee400/0xa113d808b7537b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537b87 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582682.233400:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ee400, rc 0) 00000100:00100000:3.0:1787582682.233433:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186183424:12345-0@lo:101: Request processed in 123us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582682.233439:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787582682.233525:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186183424:0@lo:101: 00010000:00010000:1.0:1787582682.233545:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b8e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.233553:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537b8e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582682.233597:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186183552:0@lo:501: 00000100:00100000:1.0:1787582682.233624:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582682.233642:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787582682.233680:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186183552 00000100:00100000:3.0:1787582682.233684:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186183552 00000100:00100000:3.0:1787582682.233714:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787582682.233720:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186183552:12345-0@lo:501: 00000100:00100000:3.0:1787582682.234230:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186183552:12345-0@lo:501: Request processed in 508us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582682.234400:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787582682.234440:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186183552:0@lo:501: 00000100:00100000:3.0:1787582682.234471:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186183680:0@lo:503: 00000100:00100000:3.0:1787582682.234509:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582682.234538:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a169b840 going to sleep for 11 seconds 00000100:00100000:1.0:1787582682.234598:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186183680 00000100:00100000:1.0:1787582682.234603:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186183680 00000100:00100000:1.0:1787582682.234635:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787582682.234642:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186183680:12345-0@lo:503: 00000100:00100000:1.0:1787582682.234862:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186183680:12345-0@lo:503: Request processed in 220us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582682.234868:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787582682.234948:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186183680:0@lo:503: 00000100:00100000:1.0:1787582682.236488:0:8035:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8035:1874416186183808:0@lo:502: 00000100:00100000:1.0:1787582682.236557:0:8035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582682.236601:0:8035:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787582682.236696:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186183808 00000100:00100000:3.0:1787582682.236703:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186183808 00000100:00100000:3.0:1787582682.236750:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787582682.236857:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:8035:x1874416186183808:12345-0@lo:502: 00000100:00100000:3.0:1787582682.237098:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:8035:x1874416186183808:12345-0@lo:502: Request processed in 243us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582682.237147:0:8035:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8035:1874416186183808:0@lo:502: 00000100:00100000:1.0:1787582682.237195:0:8035:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8035:1874416186183936:0@lo:502: 00000100:00100000:1.0:1787582682.237227:0:8035:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582682.237257:0:8035:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787582682.242872:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186183936 00000100:00100000:2.0:1787582682.242887:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186183936 00000100:00100000:2.0:1787582682.242943:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787582682.242953:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:8035:x1874416186183936:12345-0@lo:502: 00000100:00100000:3.0:1787582682.243940:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787582682.244226:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+16:8035:x1874416186183936:12345-0@lo:502: Request processed in 1272us (6995us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582682.245194:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787582682.247937:0:8035:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8035:1874416186183936:0@lo:502: 00000040:00080000:2.0:1787582682.247981:0:8035:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787582682.248132:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787582682.248155:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787582682.248164:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b8e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.248181:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b8e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582682.248190:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787582682.248192:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8da584c3b800 from 5 10000000:01000000:1.0:1787582682.248195:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787582682.248227:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.248303:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.248372:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582682.248394:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186184064:0@lo:101: 00000100:00100000:1.0:1787582682.248467:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582682.248512:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582682.249940:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186184064 00000100:00100000:2.0:1787582682.249952:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186184064 00000100:00100000:2.0:1787582682.249998:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787582682.250008:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186184064:12345-0@lo:101: 00010000:00010000:2.0:1787582682.250021:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582682.250036:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da58147e200/0xa113d808b7537b9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537b95 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582682.250056:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da58147e200/0xa113d808b7537b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537b95 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582682.250078:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da58147e200/0xa113d808b7537b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537b95 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582682.250086:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147e200, rc 0) 00000100:00100000:2.0:1787582682.250145:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186184064:12345-0@lo:101: Request processed in 138us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582682.250151:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787582682.250881:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186184064:0@lo:101: 00010000:00010000:1.0:1787582682.250900:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.250911:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537b9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582682.250973:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186184192:0@lo:256: 00000100:00100000:1.0:1787582682.251012:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582682.251070:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582682.251116:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186184192 00000100:00100000:2.0:1787582682.251121:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186184192 00000100:00100000:2.0:1787582682.251157:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787582682.251170:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186184192:12345-0@lo:256: 20000000:01000000:2.0:1787582682.251185:0:5847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787582682.251199:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787582682.251202:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787582682.251292:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186184192:12345-0@lo:256: Request processed in 121us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582682.251299:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787582682.251354:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186184192:0@lo:256: 10000000:01000000:2.0:1787582682.251399:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787582682.251406:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582682.251414:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582682.251422:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787582682.251424:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787582682.251427:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787582682.251447:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da58147f000/0xa113d808b7537ba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582682.251454:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da58147f000/0xa113d808b7537ba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582682.251462:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da58147f000/0xa113d808b7537ba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582682.251473:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186184320:0@lo:101: 00000100:00100000:2.0:1787582682.251498:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582682.251520:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582682.251532:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186184320 00000100:00100000:2.0:1787582682.251535:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186184320 00000100:00100000:2.0:1787582682.251556:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787582682.251561:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186184320:12345-0@lo:101: 00010000:00010000:2.0:1787582682.251568:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582682.251578:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da58147e600/0xa113d808b7537baa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537ba3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582682.251592:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da58147e600/0xa113d808b7537baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537ba3 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582682.251599:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da58147e600/0xa113d808b7537baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537ba3 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582682.251606:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147e600, rc 0) 00000100:00100000:2.0:1787582682.251634:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186184320:12345-0@lo:101: Request processed in 72us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582682.251639:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787582682.251668:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186184320:0@lo:101: 00010000:00010000:2.0:1787582682.251678:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da58147f000/0xa113d808b7537ba3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537baa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582682.251685:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da58147f000/0xa113d808b7537ba3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537baa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582682.251726:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186184448:0@lo:501: 00000100:00100000:2.0:1787582682.251749:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582682.251896:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582682.251913:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186184448 00000100:00100000:2.0:1787582682.251916:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186184448 00000100:00100000:2.0:1787582682.251936:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787582682.251941:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186184448:12345-0@lo:501: 00000100:00100000:2.0:1787582682.252180:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186184448:12345-0@lo:501: Request processed in 237us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582682.252187:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787582682.252219:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186184448:0@lo:501: 00000100:00100000:2.0:1787582682.252881:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186184576:0@lo:503: 00000100:00100000:2.0:1787582682.252928:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582682.253004:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787582682.257017:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186184576 00000100:00100000:1.0:1787582682.257032:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186184576 00000100:00100000:1.0:1787582682.257218:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787582682.257229:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186184576:12345-0@lo:503: 00000100:00100000:1.0:1787582682.257629:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186184576:12345-0@lo:503: Request processed in 401us (4699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582682.257637:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787582682.257737:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186184576:0@lo:503: 00000100:00100000:3.0:1787582682.261944:0:8039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8039:1874416186184704:0@lo:502: 00000100:00100000:3.0:1787582682.262020:0:8039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582682.262057:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186184704 00000100:00100000:3.0:1787582682.262074:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186184704 00000100:00100000:3.0:1787582682.262109:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787582682.262117:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:8039:x1874416186184704:12345-0@lo:502: 00000100:00100000:3.0:1787582682.262407:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:8039:x1874416186184704:12345-0@lo:502: Request processed in 289us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582682.262414:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787582682.262461:0:8039:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a169b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582682.262478:0:8039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8039:1874416186184704:0@lo:502: 00000020:01000000:3.0:1787582682.262504:0:8039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787582682.262511:0:8039:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787582682.262518:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582682.262520:0:8039:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787582682.262525:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787582682.262528:0:8039:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.120@tcp to nid 0x20000c0a8ce78 (192.168.206.120@tcp) 00000020:01000000:3.0:1787582682.262548:0:8039:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787582682.262557:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787582682.262580:0:8039:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8da5bf2d8000) 00000020:00000080:3.0:1787582682.262599:0:8039:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787582682.262605:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787582682.262667:0:8039:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787582682.262673:0:8039:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787582682.262679:0:8039:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa113d808b7537bb8 00010000:00080000:3.0:1787582682.262707:0:8039:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8da5b6089800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.120@tcp at head 00010000:00010000:3.0:1787582682.262938:0:8039:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1787582682.263242:0:8039:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1787582682.263253:0:8039:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787582682.263767:0:8039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787582682.263981:0:8039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787582682.264033:0:8039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1787582682.264108:0:8039:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1787582682.265740:0:8040:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787582682.265747:0:8040:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787582682.266613:0:8039:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787582682.266624:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787582682.266654:0:8039:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787582682.266676:0:8039:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa113d808b7537bbf 00000100:00080000:1.0:1787582682.266685:0:8039:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787582682.266691:0:8039:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8da5b6089800 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:1.0:1787582682.266724:0:8039:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5b4fa0e00 x1874416186184832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787582682.266746:0:8039:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787582682.266908:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186184832:0@lo:8: 00000100:00100000:2.0:1787582682.266971:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582682.267099:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186184832 00000100:00100000:3.0:1787582682.267107:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186184832 00000100:00100000:3.0:1787582682.267143:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787582682.267150:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874416186184832:12345-0@lo:8: 00010000:00080000:3.0:1787582682.267172:0:6705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 223 last 0 00000020:00000080:3.0:1787582682.267192:0:6705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa113d808b7537bc6 00002000:00100000:3.0:1787582682.267203:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8da5b62aa800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787582682.267207:0:6705:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1787582682.267210:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787582682.267448:0:6705:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787582682.267582:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787582682.267602:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8da5b62ad800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787582682.267667:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874416186184832:12345-0@lo:8: Request processed in 517us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582682.267675:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787582682.267741:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5b4fa0e00 x1874416186184832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787582692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582682.267751:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787582682.267768:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787582682.267775:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787582682.267779:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787582682.267782:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5b6089800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787582682.267797:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787582682.267801:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186184832:0@lo:8: 00000020:01000000:1.0:1787582682.267958:0:8039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582682.267963:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582682.267964:0:8039:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787582682.267967:0:8039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582682.267971:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582682.267972:0:8039:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787582682.267974:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787582682.267976:0:8039:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787582682.267998:0:8039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8039:1874416186184960:0@lo:502: 00000100:00100000:1.0:1787582682.268040:0:8039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582682.268075:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186184960 00000100:00100000:1.0:1787582682.268080:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186184960 00000100:00100000:1.0:1787582682.268112:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787582682.268118:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:8039:x1874416186184960:12345-0@lo:502: 00000004:00080000:3.0:1787582682.268347:0:8040:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787582682.268436:0:8040:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 223275117131ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787582682.268613:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186185216:0@lo:400: 00000100:00100000:2.0:1787582682.268644:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582682.268668:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787582682.268673:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186185088:0@lo:400: 00000100:00100000:2.0:1787582682.268709:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582682.268736:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186185344:0@lo:400: 00000100:00100000:1.0:1787582682.268953:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:8039:x1874416186184960:12345-0@lo:502: Request processed in 834us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582682.268961:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787582682.269054:0:8039:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787582682.269081:0:8039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8039:1874416186184960:0@lo:502: 00000020:01000000:1.0:1787582682.269103:0:8039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582682.269108:0:8039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582682.269109:0:8039:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787582682.269113:0:8039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1787582682.269866:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582682.269898:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787582682.269906:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186185472:0@lo:400: 00000100:00100000:2.0:1787582682.269942:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582682.269977:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186185216 00000100:00100000:2.0:1787582682.269982:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186185216 00000100:00100000:2.0:1787582682.270020:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787582682.270027:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186185216:12345-0@lo:400: 00000100:00100000:2.0:1787582682.270082:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186185216:12345-0@lo:400: Request processed in 55us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582682.270088:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787582682.270107:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186185088 00000100:00100000:2.0:1787582682.270110:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186185088 00000100:00100000:2.0:1787582682.270132:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186185344 00000100:00100000:2.0:1787582682.270134:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186185344 00000100:00100000:2.0:1787582682.270152:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186185472 00000100:00100000:2.0:1787582682.270154:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186185472 00000100:00100000:2.0:1787582682.270166:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787582682.270172:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186185088:12345-0@lo:400: 00000100:00100000:2.0:1787582682.270201:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186185088:12345-0@lo:400: Request processed in 29us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582682.270207:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787582682.270218:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787582682.270223:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186185344:12345-0@lo:400: 00000100:00100000:2.0:1787582682.270248:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186185344:12345-0@lo:400: Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582682.270259:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787582682.270270:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787582682.270275:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186185472:12345-0@lo:400: 00000100:00100000:2.0:1787582682.270298:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186185472:12345-0@lo:400: Request processed in 23us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582682.270304:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787582682.270340:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787582682.270380:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5855c2680 x1874416186185088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582682.270391:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186185088:0@lo:400: 00010000:00080000:2.0:1787582682.270400:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5855c3100 x1874416186185216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582682.270407:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186185216:0@lo:400: 00010000:00080000:2.0:1787582682.270429:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5855c0a80 x1874416186185472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582682.270435:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186185472:0@lo:400: 00010000:00080000:2.0:1787582682.270442:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5855c3800 x1874416186185344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582682.270449:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186185344:0@lo:400: 00000020:01000000:1.0:1787582682.273396:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787582682.273424:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787582682.273434:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da58147f000/0xa113d808b7537ba3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537baa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.273445:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da58147f000/0xa113d808b7537ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537baa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582682.273455:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787582682.273457:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8da588590000 from 1 10000000:01000000:1.0:1787582682.273460:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787582682.273492:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.273501:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.273512:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537bcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582682.273546:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186185600:0@lo:101: 00000100:00100000:1.0:1787582682.273603:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582682.273635:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787582682.273654:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186185600 00000100:00100000:1.0:1787582682.273660:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186185600 00000100:00100000:1.0:1787582682.273697:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787582682.273705:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186185600:12345-0@lo:101: 00010000:00010000:1.0:1787582682.273716:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582682.273727:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da581687200/0xa113d808b7537bd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537bcd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.273747:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da581687200/0xa113d808b7537bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537bcd expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.274183:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da581687200/0xa113d808b7537bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537bcd expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.274193:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da581687200, rc 0) 00000100:00100000:1.0:1787582682.274301:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186185600:12345-0@lo:101: Request processed in 529us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582682.274310:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787582682.274374:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186185600:0@lo:101: 00010000:00010000:1.0:1787582682.274388:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537bcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537bd4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.274397:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537bcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537bd4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582682.274453:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186185728:0@lo:501: 00000100:00100000:1.0:1787582682.274481:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582682.274501:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787582682.274514:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186185728 00000100:00100000:1.0:1787582682.274518:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186185728 00000100:00100000:1.0:1787582682.274541:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787582682.274548:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186185728:12345-0@lo:501: 00000100:00100000:1.0:1787582682.278488:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186185728:12345-0@lo:501: Request processed in 206us (273us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787582682.278503:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787582682.278576:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186185728:0@lo:501: 10000000:01000000:1.0:1787582682.278612:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787582682.278621:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537bcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537bd4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582682.278632:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537bd4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787582682.323545:0:8041:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787582682.323573:0:8041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1874416186185984:0@lo:7: 00000100:00100000:1.0:1787582682.323641:0:8041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582682.323681:0:8041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c000 going to sleep for 11 seconds 00000004:00080000:1.0:1787582682.323701:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787582682.323729:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186185856:0@lo:13: 00000100:00100000:1.0:1787582682.324138:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582682.324207:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186185984 00000100:00100000:1.0:1787582682.324214:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186185984 00000100:00100000:0.0:1787582682.324344:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186185856 00000100:00100000:0.0:1787582682.324349:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186185856 00000100:00100000:0.0:1787582682.324390:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787582682.324399:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874416186185856:12345-0@lo:13: 00002000:00000024:0.0:1787582682.324432:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787582682.324484:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874416186185856:12345-0@lo:13: Request processed in 86us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582682.324491:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787582682.324534:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5b4fa1c00 x1874416186185856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582698 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582682.324552:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186185856:0@lo:13: 00000100:00100000:1.0:1787582682.324636:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787582682.324645:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8041:x1874416186185984:12345-0@lo:7: 00000100:00080000:0.0:1787582682.325384:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1787582682.333386:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787582682.333394:0:6705:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787582682.333485:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8041:x1874416186185984:12345-0@lo:7: Request processed in 8838us (9840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582682.333496:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787582682.334002:0:8041:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5b4fa0a80 x1874416186185984/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787582698 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582682.334021:0:8041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1874416186185984:0@lo:7: 00000004:00080000:3.0:1787582682.334046:0:8041:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787582682.334093:0:8041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1874416186186112:0@lo:5: 00000100:00100000:3.0:1787582682.334130:0:8041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582682.334168:0:8041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5857ce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582682.334344:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186186112 00000100:00100000:2.0:1787582682.334350:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186186112 00000100:00100000:2.0:1787582682.336081:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787582682.336098:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8041:x1874416186186112:12345-0@lo:5: 00002000:00080000:2.0:1787582682.336127:0:6704:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787582682.336137:0:6704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787582682.336648:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8041:x1874416186186112:12345-0@lo:5: Request processed in 554us (2514us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787582682.336655:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787582682.336698:0:8041:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5892df480 x1874416186186112/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787582698 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582682.336714:0:8041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1874416186186112:0@lo:5: 00000004:00080000:2.0:1787582682.336726:0:8041:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787582682.336958:0:8041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1874416186186240:0@lo:700: 00000100:00100000:2.0:1787582682.336994:0:8041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582682.337204:0:8041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1da80 going to sleep for 11 seconds 00000100:00100000:0.0:1787582682.337360:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186186240 00000100:00100000:0.0:1787582682.337368:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186186240 00000100:00100000:0.0:1787582682.337407:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787582682.337415:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8041:x1874416186186240:12345-0@lo:700: 00000100:00100000:0.0:1787582682.337446:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcd880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6711:1874416186186368:0@lo:700: 00000100:00100000:0.0:1787582682.337482:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582682.337509:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58565c480 going to sleep for 11 seconds 00000100:00100000:1.0:1787582682.337654:0:5860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186186368 00000100:00100000:1.0:1787582682.337659:0:5860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186186368 00000100:00100000:1.0:1787582682.337695:0:5860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582682.337702:0:5860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6711:x1874416186186368:12345-0@lo:700: 40000000:02000000:1.0:1787582682.411019:0:5860:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787582682.419010:0:5860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6711:x1874416186186368:12345-0@lo:700: Request processed in 81302us (81519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582682.419024:0:5860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787582682.419225:0:6711:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adbcd880 x1874416186186368/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787582698 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582682.419248:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcd880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6711:1874416186186368:0@lo:700: 40000000:02000000:0.0:1787582682.419260:0:6711:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1787582682.526091:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1787582682.526111:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1787582682.526436:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8041:x1874416186186240:12345-0@lo:700: Request processed in 189016us (189435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582682.526457:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787582682.526598:0:8041:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb6e6680 x1874416186186240/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787582698 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582682.526609:0:8041:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787582682.526625:0:8041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1874416186186240:0@lo:700: 00010000:00010000:2.0:1787582682.576902:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:0.0:1787582682.604546:0:8041:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787582682.620019:0:8041:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1874416186186496:0@lo:5: 00000100:00100000:2.0:1787582682.623590:0:8041:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582682.623643:0:8041:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fd0240 going to sleep for 11 seconds 00000100:00100000:2.0:1787582682.624415:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186186496 00000100:00100000:2.0:1787582682.624424:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186186496 00000100:00100000:2.0:1787582682.624471:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787582682.624480:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8041:x1874416186186496:12345-0@lo:5: 00002000:00080000:2.0:1787582682.645189:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787582682.645207:0:6705:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787582682.668430:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8041:x1874416186186496:12345-0@lo:5: Request processed in 43941us (44834us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787582682.668443:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787582682.668498:0:8041:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adbcd880 x1874416186186496/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787582698 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582682.668515:0:8041:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8041:1874416186186496:0@lo:5: 00000004:00080000:2.0:1787582682.668531:0:8041:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1787582683.600557:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582684.625337:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582685.650958:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582686.304524:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186186624:0@lo:13: 00000100:00100000:1.0:1787582686.304592:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582686.304705:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186186624 00000100:00100000:0.0:1787582686.304714:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186186624 00000100:00100000:0.0:1787582686.304771:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787582686.304793:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186186624:12345-0@lo:13: 00002000:00000024:0.0:1787582686.304827:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787582686.307777:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787582686.308353:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186186624:12345-0@lo:13: Request processed in 3568us (3756us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582686.308364:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787582686.308722:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb6e4700 x1874416186186624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582686.308746:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186186624:0@lo:13: 00010000:00010000:3.0:1787582686.672485:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787582686.738437:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1787582687.317360:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186186752:0@lo:400: 00000100:00100000:0.0:1787582687.317429:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582687.317562:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186186752 00000100:00100000:1.0:1787582687.317570:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186186752 00000100:00100000:1.0:1787582687.317624:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787582687.317633:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186186752:12345-0@lo:400: 00000100:00100000:2.0:1787582687.317978:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186187008:0@lo:400: 00000100:00100000:2.0:1787582687.318025:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582687.318116:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186186752:12345-0@lo:400: Request processed in 483us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582687.318124:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787582687.318255:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186186752:0@lo:400: 00000100:00100000:0.0:1787582687.318274:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787582687.318289:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186186880:0@lo:400: 00000100:00100000:0.0:1787582687.318345:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582687.318417:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186186880 00000100:00100000:1.0:1787582687.318423:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186186880 00000100:00100000:1.0:1787582687.318462:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787582687.318469:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186186880:12345-0@lo:400: 00000100:00100000:1.0:1787582687.318509:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186186880:12345-0@lo:400: Request processed in 40us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582687.318515:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787582687.318543:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5892dd500 x1874416186186880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582687.318555:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186186880:0@lo:400: 00000100:00100000:2.0:1787582687.318649:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787582687.318656:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186187136:0@lo:400: 00000100:00100000:2.0:1787582687.318684:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582687.318719:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186187008 00000100:00100000:2.0:1787582687.318722:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186187008 00000100:00100000:2.0:1787582687.318754:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787582687.318760:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186187008:12345-0@lo:400: 00000100:00100000:0.0:1787582687.318897:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186187136 00000100:00100000:0.0:1787582687.318901:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186187136 00000100:00100000:0.0:1787582687.318949:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787582687.318956:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186187136:12345-0@lo:400: 00000100:00080000:1.0:1787582687.319012:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582687.319188:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186187392:0@lo:400: 00000100:00100000:0.0:1787582687.319382:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186187136:12345-0@lo:400: Request processed in 425us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582687.319389:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787582687.319486:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582687.319518:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787582687.319524:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186187264:0@lo:400: 00000100:00100000:3.0:1787582687.319558:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582687.319586:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186187264 00000100:00100000:3.0:1787582687.319590:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186187264 00000100:00100000:3.0:1787582687.319619:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787582687.319625:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186187264:12345-0@lo:400: 00000100:00100000:3.0:1787582687.319656:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186187264:12345-0@lo:400: Request processed in 32us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582687.319662:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787582687.319687:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5892de300 x1874416186187264/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582687.319705:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186187264:0@lo:400: 00000100:00080000:3.0:1787582687.319724:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582687.320157:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787582687.320166:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787582687.324571:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186187392 00000100:00100000:0.0:1787582687.324585:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186187392 00000100:00100000:0.0:1787582687.324641:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787582687.324655:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787582687.324664:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186187392:12345-0@lo:400: 00000100:00100000:0.0:1787582687.324745:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186187392:12345-0@lo:400: Request processed in 82us (5258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582687.324752:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787582687.324968:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787582687.325013:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5892dd500 x1874416186187392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582687.325024:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787582687.325062:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186187392:0@lo:400: 00000100:00100000:2.0:1787582687.325243:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186187008:12345-0@lo:400: Request processed in 6481us (7216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582687.325250:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787582687.325589:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5892dc000 x1874416186187136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582687.325601:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186187136:0@lo:400: 00010000:00080000:1.0:1787582687.325621:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5892df480 x1874416186187008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582687.325629:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186187008:0@lo:400: 00010000:00010000:1.0:1787582687.696564:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582687.825382:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186187520:0@lo:13: 00000100:00100000:1.0:1787582687.825445:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582687.825618:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186187520 00000100:00100000:2.0:1787582687.825626:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186187520 00000100:00100000:2.0:1787582687.825674:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787582687.825684:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186187520:12345-0@lo:13: 00002000:00000024:2.0:1787582687.825724:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:1.0:1787582687.825929:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb6e5500 x1874416186187520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582687.825946:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186187520:0@lo:13: 00000100:00100000:2.0:1787582687.826050:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186187520:12345-0@lo:13: Request processed in 91us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582687.826057:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787582688.283139:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582688.283296:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162046336 00000100:00100000:1.0:1787582688.283305:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162046336 00000100:00100000:1.0:1787582688.283380:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 112 00000100:00100000:1.0:1787582688.283388:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2356:x1874416162046336:12345-192.168.206.20@tcp:250: 00010000:00080000:1.0:1787582688.283413:0:5848:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e9575074-4197-4fbd-89bc-d0d7fb5499a5@192.168.206.20@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:1.0:1787582688.283441:0:5848:0:(genops.c:1385:class_connect()) connect: client e9575074-4197-4fbd-89bc-d0d7fb5499a5, cookie 0xa113d808b7537bdb 00000100:00080000:1.0:1787582688.283563:0:5848:0:(import.c:65:import_set_state_nolock()) ffff8da5a8c08800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582688.283626:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+5:2356:x1874416162046336:12345-192.168.206.20@tcp:250: Request processed in 237us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582688.283644:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 112 00000100:00100000:3.0:1787582688.295010:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582688.295979:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162046208 00000100:00100000:1.0:1787582688.295991:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162046208 00000100:00100000:1.0:1787582688.296071:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 113 00000100:00100000:1.0:1787582688.296089:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+5:5585:x1874416162046208:12345-192.168.206.20@tcp:101: 00010000:00010000:1.0:1787582688.296104:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582688.296122:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da581687400/0xa113d808b7537be2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57e82 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582688.296147:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da581687400/0xa113d808b7537be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e82 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582688.296157:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da581687400/0xa113d808b7537be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e82 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582688.296183:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da581687400, rc 0) 00000100:00100000:1.0:1787582688.296242:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+6:5585:x1874416162046208:12345-192.168.206.20@tcp:101: Request processed in 162us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582688.296248:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 113 00000100:00100000:3.0:1787582688.299217:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582688.299436:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162046464 00000100:00100000:2.0:1787582688.299446:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162046464 00000100:00100000:2.0:1787582688.299500:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 114 00000100:00100000:2.0:1787582688.299511:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+6:5585:x1874416162046464:12345-192.168.206.20@tcp:501: 00000100:00100000:2.0:1787582688.299897:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+6:5585:x1874416162046464:12345-192.168.206.20@tcp:501: Request processed in 387us (685us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787582688.299914:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 114 00000100:00100000:0.0:1787582688.303494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582688.305876:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162046592 00000100:00100000:2.0:1787582688.305890:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162046592 00000100:00100000:2.0:1787582688.305961:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 115 00000100:00100000:2.0:1787582688.305972:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+6:5585:x1874416162046592:12345-192.168.206.20@tcp:101: 00010000:00010000:2.0:1787582688.305987:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582688.306005:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4e9c800/0xa113d808b7537be9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57e89 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582688.306042:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4e9c800/0xa113d808b7537be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e89 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582688.306053:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4e9c800/0xa113d808b7537be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e89 expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582688.306062:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9c800, rc 0) 00000100:00100000:2.0:1787582688.306129:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+7:5585:x1874416162046592:12345-192.168.206.20@tcp:101: Request processed in 158us (2643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582688.306135:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 115 00000100:00100000:0.0:1787582688.309524:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582688.309619:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162046720 00000100:00100000:1.0:1787582688.309628:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162046720 00000100:00100000:1.0:1787582688.309695:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 116 00000100:00100000:1.0:1787582688.309705:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+7:5585:x1874416162046720:12345-192.168.206.20@tcp:501: 00000100:00100000:1.0:1787582688.310009:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+8:5585:x1874416162046720:12345-192.168.206.20@tcp:501: Request processed in 304us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582688.310016:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 116 00000100:00100000:3.0:1787582688.317507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582688.318311:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162046848 00000100:00100000:1.0:1787582688.318346:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162046848 00000100:00100000:1.0:1787582688.319267:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 117 00000100:00100000:1.0:1787582688.319282:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+8:5585:x1874416162046848:12345-192.168.206.20@tcp:503: 00000100:00100000:1.0:1787582688.319840:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+8:5585:x1874416162046848:12345-192.168.206.20@tcp:503: Request processed in 560us (2340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582688.319848:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 117 00000100:00100000:0.0:1787582688.344231:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582688.344388:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162046976 00000100:00100000:2.0:1787582688.344398:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162046976 00000100:00100000:2.0:1787582688.344446:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 118 00000100:00100000:2.0:1787582688.344456:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+8:5603:x1874416162046976:12345-192.168.206.20@tcp:502: 00000100:00100000:2.0:1787582688.344787:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+8:5603:x1874416162046976:12345-192.168.206.20@tcp:502: Request processed in 331us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582688.344795:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 118 00000100:00100000:0.0:1787582688.377920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582688.378037:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162047104 00000100:00100000:1.0:1787582688.378046:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162047104 00000100:00100000:1.0:1787582688.378108:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 119 00000100:00100000:1.0:1787582688.378117:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+8:5603:x1874416162047104:12345-192.168.206.20@tcp:502: 00000100:00100000:1.0:1787582688.378411:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+8:5603:x1874416162047104:12345-192.168.206.20@tcp:502: Request processed in 295us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582688.378428:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 119 00000100:00100000:0.0:1787582688.381738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582688.382248:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162047232 00000100:00100000:3.0:1787582688.382265:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162047232 00000100:00100000:3.0:1787582688.382393:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 120 00000100:00100000:3.0:1787582688.382409:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+8:5585:x1874416162047232:12345-192.168.206.20@tcp:101: 00010000:00010000:3.0:1787582688.382433:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582688.382531:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4e9c600/0xa113d808b7537bf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57eb3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582688.382581:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4e9c600/0xa113d808b7537bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57eb3 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582688.382593:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4e9c600/0xa113d808b7537bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57eb3 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582688.382602:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9c600, rc 0) 00000100:00100000:2.0:1787582688.383351:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:5585:x1874416162047232:12345-192.168.206.20@tcp:101: Request processed in 914us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582688.383360:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 120 00000100:00100000:0.0:1787582688.395955:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582688.396174:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162047360 00000100:00100000:2.0:1787582688.396185:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162047360 00000100:00100000:2.0:1787582688.396357:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 121 00000100:00100000:2.0:1787582688.396368:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:5585:x1874416162047360:12345-192.168.206.20@tcp:256: 20000000:01000000:2.0:1787582688.396393:0:5846:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787582688.396415:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787582688.396419:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787582688.396422:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787582688.396425:0:5846:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787582688.400386:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:5585:x1874416162047360:12345-192.168.206.20@tcp:256: Request processed in 4010us (4429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582688.400400:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 121 00000100:00100000:3.0:1787582688.408308:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582688.408553:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162047488 00000100:00100000:2.0:1787582688.408563:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162047488 00000100:00100000:2.0:1787582688.408620:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 122 00000100:00100000:2.0:1787582688.408631:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:5585:x1874416162047488:12345-192.168.206.20@tcp:101: 00010000:00010000:2.0:1787582688.408670:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582688.408688:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4e9dc00/0xa113d808b7537bf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57eba expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582688.408977:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4e9dc00/0xa113d808b7537bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57eba expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582688.408990:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4e9dc00/0xa113d808b7537bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57eba expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582688.408999:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9dc00, rc 0) 00000100:00100000:2.0:1787582688.409069:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5585:x1874416162047488:12345-192.168.206.20@tcp:101: Request processed in 440us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582688.409077:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 122 00000100:00100000:0.0:1787582688.411521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582688.412109:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162047616 00000100:00100000:2.0:1787582688.412118:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162047616 00000100:00100000:2.0:1787582688.412220:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 123 00000100:00100000:2.0:1787582688.412230:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5585:x1874416162047616:12345-192.168.206.20@tcp:501: 00000100:00100000:2.0:1787582688.412552:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5585:x1874416162047616:12345-192.168.206.20@tcp:501: Request processed in 322us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582688.412560:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 123 00000100:00100000:0.0:1787582688.422505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582688.423043:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162047744 00000100:00100000:2.0:1787582688.423053:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162047744 00000100:00100000:2.0:1787582688.423110:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 124 00000100:00100000:2.0:1787582688.423120:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5585:x1874416162047744:12345-192.168.206.20@tcp:503: 00000100:00100000:2.0:1787582688.423511:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5585:x1874416162047744:12345-192.168.206.20@tcp:503: Request processed in 391us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582688.423537:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 124 00000100:00100000:3.0:1787582688.431652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582688.433475:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162047872 00000100:00100000:2.0:1787582688.433487:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162047872 00000100:00100000:2.0:1787582688.433686:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 125 00000100:00100000:2.0:1787582688.433698:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5609:x1874416162047872:12345-192.168.206.20@tcp:502: 00000100:00100000:2.0:1787582688.433972:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5609:x1874416162047872:12345-192.168.206.20@tcp:502: Request processed in 276us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582688.433980:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 125 00000100:00100000:0.0:1787582688.439102:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582688.439242:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162048000 00000100:00100000:1.0:1787582688.439252:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162048000 00000100:00100000:1.0:1787582688.439304:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 126 00000100:00100000:1.0:1787582688.439314:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5609:x1874416162048000:12345-192.168.206.20@tcp:502: 00000100:00100000:1.0:1787582688.439924:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5609:x1874416162048000:12345-192.168.206.20@tcp:502: Request processed in 610us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582688.439933:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 126 00000100:00100000:3.0:1787582688.444508:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582688.444802:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162048128 00000100:00100000:0.0:1787582688.444811:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162048128 00000100:00100000:0.0:1787582688.444866:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 4 00000100:00100000:0.0:1787582688.444874:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2356:x1874416162048128:12345-192.168.206.20@tcp:38: 00010000:00080000:0.0:1787582688.444912:0:5852:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:0.0:1787582688.444956:0:5852:0:(genops.c:1385:class_connect()) connect: client 730f9f4f-46d8-441e-9162-5fde1074d6a5, cookie 0xa113d808b7537bfe 00000004:00100000:0.0:1787582688.444984:0:5852:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787582688.444990:0:5852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787582688.480113:0:5852:0:(import.c:65:import_set_state_nolock()) ffff8da5a8c0d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582688.480190:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2356:x1874416162048128:12345-192.168.206.20@tcp:38: Request processed in 35314us (35728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582688.480200:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 4 00010000:00010000:3.0:1787582688.726816:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582689.484492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582689.484625:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162048256 00000100:00100000:0.0:1787582689.484639:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162048256 00000100:00080000:3.0:1787582689.484820:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582689.485181:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 5 00000100:00100000:0.0:1787582689.485196:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:0:x1874416162048256:12345-192.168.206.20@tcp:41: 00000004:00000024:0.0:1787582689.485253:0:5855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787582689.485378:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:0:x1874416162048256:12345-192.168.206.20@tcp:41: Request processed in 185us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582689.485387:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 5 00000100:00100000:3.0:1787582689.486934:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582689.490763:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162048384 00000100:00100000:2.0:1787582689.490781:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162048384 00000100:00100000:2.0:1787582689.490855:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 6 00000100:00100000:2.0:1787582689.490865:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:5585:x1874416162048384:12345-192.168.206.20@tcp:41: 00000004:00000024:2.0:1787582689.490901:0:7653:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787582689.490985:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:5585:x1874416162048384:12345-192.168.206.20@tcp:41: Request processed in 121us (4072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582689.490992:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 6 00000100:00100000:3.0:1787582689.493532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582689.493624:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162048512 00000100:00100000:2.0:1787582689.493635:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162048512 00000100:00100000:2.0:1787582689.493696:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 7 00000100:00100000:2.0:1787582689.493708:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:5585:x1874416162048512:12345-192.168.206.20@tcp:40: 00000100:00100000:2.0:1787582689.494118:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:5585:x1874416162048512:12345-192.168.206.20@tcp:40: Request processed in 411us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582689.494127:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 7 00000100:00100000:2.0:1787582689.501547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582689.501582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582689.501913:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162048640 00000100:00100000:0.0:1787582689.501926:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162048640 00000100:00100000:0.0:1787582689.502053:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:0.0:1787582689.502063:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1874416162048640:12345-192.168.206.20@tcp:8: 00010000:00080000:0.0:1787582689.502102:0:6705:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:0.0:1787582689.502140:0:6705:0:(genops.c:1385:class_connect()) connect: client 730f9f4f-46d8-441e-9162-5fde1074d6a5, cookie 0xa113d808b7537c05 00002000:00100000:0.0:1787582689.502154:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 730f9f4f-46d8-441e-9162-5fde1074d6a5/ffff8da58df19800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787582689.502181:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787582689.502628:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787582689.502701:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8da5855d2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787582689.502809:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2356:x1874416162048640:12345-192.168.206.20@tcp:8: Request processed in 744us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582689.502818:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:2.0:1787582689.504492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582689.504530:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582689.504743:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162048896 00000100:00100000:3.0:1787582689.504771:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162048896 00000100:00100000:3.0:1787582689.504839:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 0 00000100:00100000:3.0:1787582689.504862:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:5585:x1874416162048896:12345-192.168.206.20@tcp:33: 00000100:00100000:3.0:1787582689.505174:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162049024 00000100:00100000:3.0:1787582689.505178:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162049024 00000100:00100000:3.0:1787582689.505209:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 127 00000100:00100000:3.0:1787582689.505216:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2360:x1874416162049024:12345-192.168.206.20@tcp:400: 00000100:00100000:3.0:1787582689.505282:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2360:x1874416162049024:12345-192.168.206.20@tcp:400: Request processed in 66us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582689.505289:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 127 00000100:00100000:1.0:1787582689.505660:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162048768 00000100:00100000:1.0:1787582689.505666:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162048768 00000100:00100000:1.0:1787582689.505695:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00100000:1.0:1787582689.505702:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1874416162048768:12345-192.168.206.20@tcp:8: 00010000:00080000:1.0:1787582689.505730:0:8218:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1787582689.505764:0:8218:0:(genops.c:1385:class_connect()) connect: client 730f9f4f-46d8-441e-9162-5fde1074d6a5, cookie 0xa113d808b7537c0c 00002000:00100000:1.0:1787582689.505777:0:8218:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 730f9f4f-46d8-441e-9162-5fde1074d6a5/ffff8da5a8c0f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787582689.505805:0:8218:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787582689.506925:0:8218:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787582689.506972:0:8218:0:(import.c:65:import_set_state_nolock()) ffff8da5b6088000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582689.507122:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2356:x1874416162048768:12345-192.168.206.20@tcp:8: Request processed in 1417us (2589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582689.507133:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 10 00000004:00080000:3.0:1787582689.544060:0:5856:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 38923us 00000004:00200000:3.0:1787582689.581446:0:5856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787582689.581662:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:5585:x1874416162048896:12345-192.168.206.20@tcp:33: Request processed in 76794us (80069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582689.581676:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 0 00010000:00010000:1.0:1787582689.744706:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582689.786872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582689.787133:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162049152 00000100:00100000:3.0:1787582689.787146:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162049152 00000100:00100000:3.0:1787582689.787234:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 8 00000100:00100000:3.0:1787582689.787246:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:5626:x1874416162049152:12345-192.168.206.20@tcp:101: 00010000:00010000:3.0:1787582689.787271:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582689.787583:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7537c13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57ee4 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582689.787662:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef600/0xa113d808b7537c1a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582689.787675:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef600/0xa113d808b7537c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582689.787772:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef600/0xa113d808b7537c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582689.787966:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787582689.787970:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787582689.788057:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef600/0xa113d808b7537c1a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582689.788088:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7537c13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ee4 expref: 8 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582689.788106:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef600/0xa113d808b7537c1a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ee4 expref: 7 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582689.788114:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da583acc100) 00010000:00010000:3.0:1787582689.788117:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787582689.788121:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ef600, rc 0) 00000100:00100000:3.0:1787582689.788274:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:5626:x1874416162049152:12345-192.168.206.20@tcp:101: Request processed in 1028us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582689.788282:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 8 00010000:00010000:3.0:1787582690.769594:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582691.408637:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186187648:0@lo:13: 00000100:00100000:1.0:1787582691.408702:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582691.408894:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186187648 00000100:00100000:2.0:1787582691.408903:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186187648 00000100:00100000:2.0:1787582691.408998:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787582691.409015:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186187648:12345-0@lo:13: 00002000:00000024:2.0:1787582691.409049:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582691.409093:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186187648:12345-0@lo:13: Request processed in 88us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582691.409100:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787582691.409151:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb6e6d80 x1874416186187648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787582691.409153:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787582691.409174:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186187648:0@lo:13: 00010000:00010000:1.0:1787582691.793101:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582692.001504:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582692.001648:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162049280 00000100:00100000:1.0:1787582692.001659:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162049280 00000100:00080000:3.0:1787582692.001719:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582692.001747:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:1.0:1787582692.001760:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:5678:x1874416162049280:12345-192.168.206.20@tcp:41: 00000004:00000024:1.0:1787582692.001804:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787582692.001873:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:5678:x1874416162049280:12345-192.168.206.20@tcp:41: Request processed in 116us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582692.001880:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:2.0:1787582692.008649:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582692.012364:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162049408 00000100:00100000:1.0:1787582692.012379:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162049408 00000100:00100000:1.0:1787582692.012472:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:1.0:1787582692.012482:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:5678:x1874416162049408:12345-192.168.206.20@tcp:13: 00002000:00000024:1.0:1787582692.012506:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582692.012583:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:5678:x1874416162049408:12345-192.168.206.20@tcp:13: Request processed in 101us (3943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582692.012590:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00080000:3.0:1787582692.012875:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787582692.024170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582692.024274:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162049536 00000100:00100000:1.0:1787582692.024283:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162049536 00000100:00100000:1.0:1787582692.024375:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00100000:1.0:1787582692.024385:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:5678:x1874416162049536:12345-192.168.206.20@tcp:13: 00002000:00000024:1.0:1787582692.024421:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582692.024490:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:5678:x1874416162049536:12345-192.168.206.20@tcp:13: Request processed in 106us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582692.024511:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00080000:3.0:1787582692.024574:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787582692.434754:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186187904:0@lo:400: 00000100:00100000:3.0:1787582692.434820:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582692.434886:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186188416:0@lo:400: 00000100:00100000:3.0:1787582692.434911:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582692.434940:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787582692.434946:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186187776:0@lo:400: 00000100:00100000:3.0:1787582692.434973:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582692.434991:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186188288:0@lo:400: 00000100:00100000:3.0:1787582692.435027:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582692.435051:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186188032:0@lo:400: 00000100:00100000:3.0:1787582692.435072:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582692.435087:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787582692.435093:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186188160:0@lo:400: 00000100:00100000:3.0:1787582692.435112:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582692.435138:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186187904 00000100:00100000:3.0:1787582692.435144:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186187904 00000100:00100000:3.0:1787582692.435184:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186188288 00000100:00100000:3.0:1787582692.435187:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186188288 00000100:00100000:3.0:1787582692.435207:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186188160 00000100:00100000:3.0:1787582692.435209:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186188160 00000100:00100000:3.0:1787582692.435225:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787582692.435232:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186187904:12345-0@lo:400: 00000100:00100000:3.0:1787582692.435281:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186187904:12345-0@lo:400: Request processed in 48us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582692.435289:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787582692.435305:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787582692.435311:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186188288:12345-0@lo:400: 00000100:00100000:3.0:1787582692.435359:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186188288:12345-0@lo:400: Request processed in 48us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582692.435373:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787582692.435388:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787582692.435394:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186188160:12345-0@lo:400: 00000100:00100000:3.0:1787582692.435428:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186188160:12345-0@lo:400: Request processed in 34us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582692.435433:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787582692.435451:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582692.435477:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186188160:0@lo:400: 00000100:00100000:3.0:1787582692.435505:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf926d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186188288:0@lo:400: 00000100:00100000:3.0:1787582692.435514:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186187904:0@lo:400: 00000100:00100000:1.0:1787582692.435679:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186188416 00000100:00100000:1.0:1787582692.435684:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186188416 00000100:00100000:1.0:1787582692.435724:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186188032 00000100:00100000:1.0:1787582692.435727:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186188032 00000100:00100000:1.0:1787582692.435746:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787582692.435753:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186188416:12345-0@lo:400: 00000100:00100000:1.0:1787582692.435793:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186188416:12345-0@lo:400: Request processed in 41us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582692.435798:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787582692.435810:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787582692.435816:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186188032:12345-0@lo:400: 00000100:00100000:1.0:1787582692.435849:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186188032:12345-0@lo:400: Request processed in 33us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582692.435855:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787582692.435891:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bf925180 x1874416186188032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582692.435901:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186188032:0@lo:400: 00010000:00080000:1.0:1787582692.435928:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bf927100 x1874416186188416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582692.435937:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186188416:0@lo:400: 00000100:00080000:3.0:1787582692.436043:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787582692.439191:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186187776 00000100:00100000:2.0:1787582692.439205:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186187776 00000100:00100000:2.0:1787582692.439261:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787582692.439271:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186187776:12345-0@lo:400: 00000100:00100000:2.0:1787582692.439367:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186187776:12345-0@lo:400: Request processed in 97us (4392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582692.439374:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787582692.439545:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186187776:0@lo:400: 00010000:00010000:3.0:1787582692.818139:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582692.948670:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787582692.948690:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186188544:0@lo:13: 00000100:00100000:0.0:1787582692.948755:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582692.948952:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186188544 00000100:00100000:1.0:1787582692.948966:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186188544 00000100:00100000:1.0:1787582692.949037:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787582692.949054:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186188544:12345-0@lo:13: 00002000:00000024:1.0:1787582692.949076:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582692.949117:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186188544:12345-0@lo:13: Request processed in 64us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582692.949124:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1787582692.949600:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adbcc380 x1874416186188544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582692.949632:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186188544:0@lo:13: 00000001:00100000:1.0:1787582693.012492:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 730f9f4f-46d8-441e-9162-5fde1074d6a5 00000001:00100000:0.0:1787582693.552083:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 730f9f4f-46d8-441e-9162-5fde1074d6a5 00010000:00010000:1.0:1787582693.841347:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787582694.006949:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 730f9f4f-46d8-441e-9162-5fde1074d6a5 00010000:00010000:3.0:1787582694.867505:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582694.869164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582694.869220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582694.869254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582694.869444:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162049664 00000100:00100000:2.0:1787582694.869455:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162049664 00000100:00100000:2.0:1787582694.869500:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 129 00000100:00100000:2.0:1787582694.869510:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2359:x1874416162049664:12345-192.168.206.20@tcp:400: 00000100:00100000:2.0:1787582694.869568:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2359:x1874416162049664:12345-192.168.206.20@tcp:400: Request processed in 60us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582694.869575:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 129 00000100:00100000:3.0:1787582694.869667:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162049920 00000100:00100000:3.0:1787582694.869672:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162049920 00000100:00100000:3.0:1787582694.869715:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 8 00000100:00100000:3.0:1787582694.869723:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162049920:12345-192.168.206.20@tcp:400: 00000100:00100000:3.0:1787582694.869749:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162049920:12345-192.168.206.20@tcp:400: Request processed in 28us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582694.869755:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 8 00000100:00100000:3.0:1787582694.869770:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162049792 00000100:00100000:3.0:1787582694.869773:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162049792 00000100:00100000:3.0:1787582694.869794:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 22 00000100:00100000:3.0:1787582694.869800:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162049792:12345-192.168.206.20@tcp:400: 00000100:00100000:3.0:1787582694.869824:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162049792:12345-192.168.206.20@tcp:400: Request processed in 24us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582694.869835:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 22 00000100:00080000:2.0:1787582694.869882:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787582694.869887:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787582694.869956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582694.869977:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162050048 00000100:00100000:0.0:1787582694.869981:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162050048 00000100:00100000:0.0:1787582694.870023:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:0.0:1787582694.870030:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162050048:12345-192.168.206.20@tcp:400: 00000100:00100000:0.0:1787582694.870056:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162050048:12345-192.168.206.20@tcp:400: Request processed in 26us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582694.870061:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00080000:2.0:1787582694.870113:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1787582694.947379:0:8310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787582695.888843:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582696.529571:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582696.532964:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186188672:0@lo:13: 00000100:00100000:0.0:1787582696.533066:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582696.533185:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186188672 00000100:00100000:2.0:1787582696.533204:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186188672 00000100:00100000:2.0:1787582696.533425:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787582696.533438:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186188672:12345-0@lo:13: 00002000:00000024:2.0:1787582696.533485:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582696.533542:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186188672:12345-0@lo:13: Request processed in 107us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582696.533549:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787582696.533622:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb6e4000 x1874416186188672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582696.533644:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186188672:0@lo:13: 00000100:00080000:0.0:1787582696.533866:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787582696.912731:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582697.563270:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186188800:0@lo:400: 00000100:00100000:1.0:1787582697.563354:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582697.563396:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186189312:0@lo:400: 00000100:00100000:1.0:1787582697.563424:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582697.563447:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787582697.563453:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186188928:0@lo:400: 00000100:00100000:1.0:1787582697.563473:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582697.563487:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186189440:0@lo:400: 00000100:00100000:1.0:1787582697.563506:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582697.563534:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874416186189184:0@lo:400: 00000100:00100000:1.0:1787582697.563555:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582697.563573:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787582697.563579:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186189056:0@lo:400: 00000100:00100000:1.0:1787582697.563597:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582697.563622:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186188800 00000100:00100000:1.0:1787582697.563636:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186188800 00000100:00100000:1.0:1787582697.563677:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787582697.563685:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186188800:12345-0@lo:400: 00000100:00100000:1.0:1787582697.564212:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186188800:12345-0@lo:400: Request processed in 526us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582697.564220:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787582697.564255:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186189312 00000100:00100000:1.0:1787582697.564259:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186189312 00000100:00100000:1.0:1787582697.564291:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186188928 00000100:00100000:1.0:1787582697.564294:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186188928 00000100:00100000:1.0:1787582697.564305:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186189184 00000100:00100000:1.0:1787582697.564307:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186189184 00000100:00100000:1.0:1787582697.564343:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787582697.564350:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186189312:12345-0@lo:400: 00000100:00100000:1.0:1787582697.564384:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186189312:12345-0@lo:400: Request processed in 36us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582697.564389:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787582697.564401:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787582697.564407:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186188928:12345-0@lo:400: 00000100:00100000:1.0:1787582697.564431:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186188928:12345-0@lo:400: Request processed in 24us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582697.564436:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787582697.564446:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787582697.564451:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874416186189184:12345-0@lo:400: 00000100:00100000:1.0:1787582697.564481:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874416186189184:12345-0@lo:400: Request processed in 30us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582697.564487:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787582697.564514:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186189440 00000100:00100000:1.0:1787582697.564518:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186189440 00000100:00100000:1.0:1787582697.564541:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186189056 00000100:00100000:1.0:1787582697.564544:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186189056 00000100:00100000:1.0:1787582697.564563:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787582697.564570:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186189440:12345-0@lo:400: 00000100:00100000:1.0:1787582697.564600:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186189440:12345-0@lo:400: Request processed in 31us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582697.564605:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787582697.564616:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787582697.564621:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186189056:12345-0@lo:400: 00000100:00100000:1.0:1787582697.564646:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186189056:12345-0@lo:400: Request processed in 25us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582697.564651:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787582697.564674:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787582697.564677:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787582697.564709:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adf7a680 x1874416186189056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582697.564916:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186188928:0@lo:400: 00010000:00080000:2.0:1787582697.564928:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adf78700 x1874416186189440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582697.564938:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186189440:0@lo:400: 00000100:00100000:2.0:1787582697.564948:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186188800:0@lo:400: 00000100:00100000:2.0:1787582697.564955:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186189312:0@lo:400: 00000100:00100000:1.0:1787582697.565011:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186189056:0@lo:400: 00000100:00100000:1.0:1787582697.565025:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874416186189184:0@lo:400: 00010000:00010000:2.0:1787582697.941814:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582698.064495:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186189568:0@lo:13: 00000100:00100000:1.0:1787582698.064573:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582698.065355:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186189568 00000100:00100000:0.0:1787582698.065364:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186189568 00000100:00100000:0.0:1787582698.065423:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787582698.065431:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186189568:12345-0@lo:13: 00002000:00000024:0.0:1787582698.065462:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582698.065521:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186189568:12345-0@lo:13: Request processed in 90us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582698.065528:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787582698.065666:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adbcd500 x1874416186189568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582698.065685:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186189568:0@lo:13: 00010000:00010000:3.0:1787582698.960528:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787582699.172062:0:8458:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb50d5cf0 20000000:00000080:0.0:1787582699.172079:0:8458:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8da5bb595400 uarg=0000000000000000 20000000:01000000:0.0:1787582699.172114:0:8458:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787582699.172117:0:8458:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787582699.172119:0:8458:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787582699.172124:0:8458:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787582699.172129:0:8458:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787582699.172142:0:8458:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787582699.172145:0:8458:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787582699.172310:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787582699.172314:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787582699.173536:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787582699.174161:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787582699.174230:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787582699.174271:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1787582699.174287:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787582699.174289:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787582699.176073:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787582699.176510:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787582699.176576:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787582699.176614:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1787582699.176627:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787582699.176629:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787582699.178237:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787582699.191573:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787582699.191670:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787582699.191747:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1787582699.191771:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787582699.191773:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787582699.192725:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1787582699.193141:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1787582699.193178:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1787582699.193204:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1787582699.193219:0:8458:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787582699.193234:0:8458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8da5c20efa00/0xa113d808b7537c21 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193250:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5c20ee000/0xa113d808b7537b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537b17 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193258:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537b41 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193266:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da581686400/0xa113d808b7537b72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537b6b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193272:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5c20efe00/0xa113d808b7537b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537b79 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193289:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5c20ee400/0xa113d808b7537b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537b87 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193296:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da58147e600/0xa113d808b7537baa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537ba3 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193303:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da581687200/0xa113d808b7537bd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537bcd expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193311:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da581687400/0xa113d808b7537be2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e82 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193347:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5b4e9c800/0xa113d808b7537be9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e89 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193355:0:8458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8da5c20efa00/0xa113d808b7537c21 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193390:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5b4e9c800/0xa113d808b7537be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e89 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193404:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da5b4e9c800/0xa113d808b7537be9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e89 expref: 9 pid: 5848 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582699.193418:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf924a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186189696:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582699.193506:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da581687400/0xa113d808b7537be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e82 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193515:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da581687400/0xa113d808b7537be2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e82 expref: 9 pid: 5846 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582699.193528:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf926d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186189824:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582699.193555:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da581687200/0xa113d808b7537bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537bcd expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193562:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da581687200/0xa113d808b7537bd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537bcd expref: 18 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582699.193571:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf926a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186189952:0@lo:104: 00000100:00100000:3.0:1787582699.193603:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787582699.193647:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da58147e600/0xa113d808b7537baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537ba3 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193656:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da58147e600/0xa113d808b7537baa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537ba3 expref: 18 pid: 5848 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582699.193665:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf926680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186190080:0@lo:104: 00010000:00010000:3.0:1787582699.193688:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5c20ee400/0xa113d808b7537b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537b87 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193696:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da5c20ee400/0xa113d808b7537b8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537b87 expref: 18 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582699.193704:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf924380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186190208:0@lo:104: 00010000:00010000:3.0:1787582699.193736:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5c20efe00/0xa113d808b7537b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537b79 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193744:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da5c20efe00/0xa113d808b7537b80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537b79 expref: 18 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582699.193762:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf927100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186190336:0@lo:104: 00010000:00010000:3.0:1787582699.193782:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da581686400/0xa113d808b7537b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537b6b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193789:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da581686400/0xa113d808b7537b72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537b6b expref: 18 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582699.193796:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf925180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186190464:0@lo:104: 00010000:00010000:3.0:1787582699.193812:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537b41 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193819:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537b41 expref: 18 pid: 5847 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582699.193826:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186190592:0@lo:104: 00010000:00010000:3.0:1787582699.193841:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5c20ee000/0xa113d808b7537b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537b17 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.193848:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da5c20ee000/0xa113d808b7537b1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537b17 expref: 18 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582699.193855:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186190720:0@lo:104: 00000100:00100000:3.0:1787582699.193868:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c7e240 going to sleep for 11 seconds 00000100:00100000:1.0:1787582699.194103:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787582699.194121:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582699.194144:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582699.194151:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582699.194165:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582699.194172:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582699.194178:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582699.194186:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186189952 00000100:00100000:1.0:1787582699.194191:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186189952 00000100:00100000:1.0:1787582699.194217:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186190080 00000100:00100000:1.0:1787582699.194219:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186190080 00000100:00100000:1.0:1787582699.194226:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186190208 00000100:00100000:1.0:1787582699.194228:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186190208 00000100:00100000:1.0:1787582699.194234:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186190336 00000100:00100000:1.0:1787582699.194236:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186190336 00000100:00100000:1.0:1787582699.194243:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186190464 00000100:00100000:1.0:1787582699.194245:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186190464 00000100:00100000:1.0:1787582699.194251:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186190592 00000100:00100000:1.0:1787582699.194253:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186190592 00000100:00100000:1.0:1787582699.194260:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186190720 00000100:00100000:1.0:1787582699.194261:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186190720 00000100:00100000:1.0:1787582699.194271:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787582699.194278:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf6e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+9:8458:x1874416186189952:12345-0@lo:104: 00010000:00010000:1.0:1787582699.194288:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537bd4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582699.194345:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787582699.194352:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf6e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+9:8458:x1874416186189952:12345-0@lo:104: Request processed in 74us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582699.194359:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787582699.194388:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787582699.194393:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+8:8458:x1874416186190080:12345-0@lo:104: 00010000:00010000:1.0:1787582699.194400:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da58147f000/0xa113d808b7537ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537baa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582699.194443:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787582699.194448:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+8:8458:x1874416186190080:12345-0@lo:104: Request processed in 55us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582699.194454:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787582699.194465:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787582699.194470:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+7:8458:x1874416186190208:12345-0@lo:104: 00010000:00010000:1.0:1787582699.194476:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537b8e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582699.194497:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787582699.194501:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+7:8458:x1874416186190208:12345-0@lo:104: Request processed in 31us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582699.194506:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787582699.194514:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787582699.194518:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+6:8458:x1874416186190336:12345-0@lo:104: 00010000:00010000:1.0:1787582699.194525:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5c20ef800/0xa113d808b7537b79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582699.194542:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787582699.194546:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+6:8458:x1874416186190336:12345-0@lo:104: Request processed in 28us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582699.194551:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787582699.194558:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787582699.194563:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+5:8458:x1874416186190464:12345-0@lo:104: 00010000:00010000:1.0:1787582699.194569:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da580031800/0xa113d808b7537b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537b72 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582699.194594:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787582699.194598:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+5:8458:x1874416186190464:12345-0@lo:104: Request processed in 36us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582699.194604:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787582699.194613:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787582699.194618:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+4:8458:x1874416186190592:12345-0@lo:104: 00010000:00010000:1.0:1787582699.194624:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da58147fc00/0xa113d808b7537b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537b48 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582699.194644:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787582699.194648:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+4:8458:x1874416186190592:12345-0@lo:104: Request processed in 31us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582699.194653:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787582699.194662:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787582699.194667:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+3:8458:x1874416186190720:12345-0@lo:104: 00010000:00010000:1.0:1787582699.194673:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da581686800/0xa113d808b7537b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537b1e expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582699.194690:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1787582699.194694:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+3:8458:x1874416186190720:12345-0@lo:104: Request processed in 27us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582699.194699:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1787582699.194856:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787582699.194865:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537bd4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.194874:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581687000 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582699.194878:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537bd4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.194894:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537bd4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582699.194901:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537bd4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582699.194907:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582699.194944:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537bcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537bd4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.194950:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582699.194978:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537bcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537bd4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.194986:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da581687000/0xa113d808b7537bcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537bd4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195000:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787582699.195003:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da58147f000/0xa113d808b7537ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537baa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195008:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147f000 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582699.195010:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da58147f000/0xa113d808b7537ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537baa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195017:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da58147f000/0xa113d808b7537ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537baa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582699.195023:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da58147f000/0xa113d808b7537ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537baa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582699.195035:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582699.195051:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da58147f000/0xa113d808b7537ba3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537baa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195057:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582699.195071:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da58147f000/0xa113d808b7537ba3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537baa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195077:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da58147f000/0xa113d808b7537ba3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537baa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195087:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787582699.195091:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537b8e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195096:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581686600 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582699.195099:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537b8e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195107:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537b8e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582699.195113:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537b8e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582699.195118:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582699.195130:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b8e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195136:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582699.195148:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b8e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195154:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537b87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b8e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195164:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787582699.195166:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5c20ef800/0xa113d808b7537b79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195171:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ef800 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582699.195174:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5c20ef800/0xa113d808b7537b79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195180:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5c20ef800/0xa113d808b7537b79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582699.195186:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5c20ef800/0xa113d808b7537b79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582699.195191:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582699.195204:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5c20ef800/0xa113d808b7537b79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195210:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582699.195215:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5c20ef800/0xa113d808b7537b79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195221:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5c20ef800/0xa113d808b7537b79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195230:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787582699.195238:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da580031800/0xa113d808b7537b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537b72 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195244:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580031800 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582699.195247:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da580031800/0xa113d808b7537b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537b72 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195253:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da580031800/0xa113d808b7537b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537b72 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582699.195258:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da580031800/0xa113d808b7537b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537b72 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582699.195263:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582699.195276:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da580031800/0xa113d808b7537b6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b72 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195282:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582699.195286:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da580031800/0xa113d808b7537b6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b72 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195292:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da580031800/0xa113d808b7537b6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b72 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195300:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787582699.195303:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da58147fc00/0xa113d808b7537b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537b48 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195308:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147fc00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582699.195311:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da58147fc00/0xa113d808b7537b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537b48 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195346:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da58147fc00/0xa113d808b7537b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537b48 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582699.195352:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da58147fc00/0xa113d808b7537b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537b48 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582699.195357:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582699.195383:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da58147fc00/0xa113d808b7537b41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b48 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195389:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582699.195394:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da58147fc00/0xa113d808b7537b41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b48 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195401:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da58147fc00/0xa113d808b7537b41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b48 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195411:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582699.195415:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da581686800/0xa113d808b7537b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537b1e expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195420:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581686800 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582699.195423:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da581686800/0xa113d808b7537b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537b1e expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195429:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da581686800/0xa113d808b7537b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537b1e expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582699.195435:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da581686800/0xa113d808b7537b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537b1e expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582699.195446:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787582699.195461:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da581686800/0xa113d808b7537b17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b1e expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195467:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582699.195471:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da581686800/0xa113d808b7537b17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b1e expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195478:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da581686800/0xa113d808b7537b17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b1e expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582699.195491:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582699.195493:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582699.195495:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582699.195511:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186190848:0@lo:103: 00000100:00100000:0.0:1787582699.195549:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582699.195587:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186191360:0@lo:103: 00000100:00100000:0.0:1787582699.195611:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582699.195640:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186190976:0@lo:103: 00000100:00100000:1.0:1787582699.195677:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186191232:0@lo:103: 00010000:00010000:2.0:1787582699.195694:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582699.196047:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf926a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186189952:0@lo:104: 00000100:00100000:3.0:1787582699.196058:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf926680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186190080:0@lo:104: 00000100:00100000:3.0:1787582699.196066:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf924380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186190208:0@lo:104: 00000100:00100000:3.0:1787582699.196074:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf927100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186190336:0@lo:104: 00000100:00100000:3.0:1787582699.196092:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf925180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186190464:0@lo:104: 00000100:00100000:3.0:1787582699.196100:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186190592:0@lo:104: 00000100:00100000:3.0:1787582699.196108:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186190720:0@lo:104: 00000100:00100000:2.0:1787582699.199105:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf924a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186189696:192.168.206.20@tcp:104: 00000100:00100000:2.0:1787582699.199119:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf926d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1874416186189824:192.168.206.20@tcp:104: 00010000:00010000:2.0:1787582699.199166:0:8458:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8da5c20efa00/0xa113d808b7537c21 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582699.206451:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186191104:0@lo:103: 00000100:00100000:2.0:1787582699.211925:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582699.212006:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186191488:0@lo:103: 00000100:00100000:2.0:1787582699.212059:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582699.212420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582699.212509:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582699.215155:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186190848 00000100:00100000:2.0:1787582699.215169:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186190848 00010000:00010000:2.0:1787582699.215211:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da581687200/0xa113d808b7537bd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537bcd expref: 19 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582699.215238:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186191360 00000100:00100000:2.0:1787582699.215242:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186191360 00010000:00010000:2.0:1787582699.215253:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da581686400/0xa113d808b7537b72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537b6b expref: 20 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582699.215264:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186190976 00000100:00100000:2.0:1787582699.215267:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186190976 00010000:00010000:2.0:1787582699.215277:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da58147e600/0xa113d808b7537baa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537ba3 expref: 21 pid: 5848 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582699.215287:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186191488 00000100:00100000:2.0:1787582699.215290:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186191488 00010000:00010000:2.0:1787582699.215301:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537b41 expref: 22 pid: 5847 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582699.215310:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162050304 00000100:00100000:2.0:1787582699.215355:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162050304 00010000:00010000:2.0:1787582699.215372:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da581687400/0xa113d808b7537be2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e82 expref: 10 pid: 5846 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582699.215385:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162050176 00000100:00100000:2.0:1787582699.215388:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162050176 00010000:00010000:2.0:1787582699.215398:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5b4e9c800/0xa113d808b7537be9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e89 expref: 11 pid: 5848 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582699.215415:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787582699.215423:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787582699.215425:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+22:3314:x1874416186190848:12345-0@lo:103: 00000100:00100000:3.0:1787582699.215439:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+22:3314:x1874416186191360:12345-0@lo:103: 00010000:00010000:2.0:1787582699.215441:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582699.215451:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da581687200/0xa113d808b7537bd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537bcd expref: 22 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.215455:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582699.215463:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da581686400/0xa113d808b7537b72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537b6b expref: 22 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582699.215465:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da581687200/0xa113d808b7537bd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537bcd expref: 22 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.215487:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da581686400/0xa113d808b7537b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537b6b expref: 22 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582699.215696:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da581687200/0xa113d808b7537bd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537bcd expref: 22 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582699.215861:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582699.215881:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186191616:0@lo:103: 00000100:00100000:1.0:1787582699.215926:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582699.217424:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787582699.218163:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da581686400/0xa113d808b7537b72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537b6b expref: 21 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.218182:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582699.218293:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb680380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+20:3314:x1874416186191360:12345-0@lo:103: Request processed in 2859us (22680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582699.218303:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787582699.218339:0:5840:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787582699.218347:0:5840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787582699.218441:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186191104 00000100:00100000:3.0:1787582699.218448:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186191104 00010000:00010000:3.0:1787582699.218471:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5c20ee400/0xa113d808b7537b8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537b87 expref: 20 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582699.218488:0:5840:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787582699.218504:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186191616 00000100:00100000:3.0:1787582699.218507:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186191616 00010000:00010000:3.0:1787582699.218519:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5c20ee000/0xa113d808b7537b1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537b17 expref: 21 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582699.218530:0:5840:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787582699.218534:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186191232 00000100:00100000:3.0:1787582699.218536:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186191232 00010000:00010000:3.0:1787582699.218545:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5c20efe00/0xa113d808b7537b80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537b79 expref: 22 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582699.218555:0:5840:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787582699.218561:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787582699.218568:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+22:3311:x1874416186190976:12345-0@lo:103: 00010000:00010000:3.0:1787582699.218579:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582699.218584:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da58147e600/0xa113d808b7537baa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537ba3 expref: 22 pid: 5848 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.218594:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da58147e600/0xa113d808b7537baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537ba3 expref: 22 pid: 5848 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.218606:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da58147e600/0xa113d808b7537baa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537ba3 expref: 22 pid: 5848 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.218616:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582699.218646:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+21:3311:x1874416186190976:12345-0@lo:103: Request processed in 78us (6728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582699.218653:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787582699.218664:0:5840:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787582699.218670:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787582699.218676:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+20:3311:x1874416186191488:12345-0@lo:103: 00010000:00010000:3.0:1787582699.218689:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582699.218695:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537b41 expref: 20 pid: 5847 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.218704:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537b41 expref: 20 pid: 5847 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.218796:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da58147ec00/0xa113d808b7537b48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537b41 expref: 20 pid: 5847 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.218806:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582699.218830:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186191488:12345-0@lo:103: Request processed in 154us (6770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582699.218836:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787582699.218847:0:5840:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787582699.218855:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:3.0:1787582699.218862:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:2360:x1874416162050304:12345-192.168.206.20@tcp:103: 00010000:00010000:3.0:1787582699.218870:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582699.218876:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da581687400/0xa113d808b7537be2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e82 expref: 11 pid: 5846 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.218886:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da581687400/0xa113d808b7537be2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e82 expref: 11 pid: 5846 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.218897:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da581687400/0xa113d808b7537be2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e82 expref: 11 pid: 5846 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.218906:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582699.219016:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2360:x1874416162050304:12345-192.168.206.20@tcp:103: Request processed in 79us (6522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582699.219029:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:3.0:1787582699.219043:0:5840:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787582699.219049:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 17 00000100:00100000:3.0:1787582699.219056:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:2360:x1874416162050176:12345-192.168.206.20@tcp:103: 00010000:00010000:3.0:1787582699.219064:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582699.219068:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5b4e9c800/0xa113d808b7537be9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e89 expref: 9 pid: 5848 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219079:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5b4e9c800/0xa113d808b7537be9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e89 expref: 9 pid: 5848 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219089:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4e9c800/0xa113d808b7537be9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57e89 expref: 9 pid: 5848 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219096:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582699.219115:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+8:2360:x1874416162050176:12345-192.168.206.20@tcp:103: Request processed in 60us (6607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582699.219121:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 17 00000100:00100000:3.0:1787582699.219132:0:5840:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787582699.219138:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787582699.219143:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:3312:x1874416186191104:12345-0@lo:103: 00010000:00010000:3.0:1787582699.219151:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582699.219156:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5c20ee400/0xa113d808b7537b8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537b87 expref: 18 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219165:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5c20ee400/0xa113d808b7537b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537b87 expref: 18 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219186:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5c20ee400/0xa113d808b7537b8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537b87 expref: 18 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219196:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582699.219233:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:3312:x1874416186191104:12345-0@lo:103: Request processed in 89us (3372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582699.219239:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787582699.219251:0:5840:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787582699.219257:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787582699.219263:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:3312:x1874416186191616:12345-0@lo:103: 00010000:00010000:3.0:1787582699.219270:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582699.219274:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5c20ee000/0xa113d808b7537b1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537b17 expref: 16 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219282:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5c20ee000/0xa113d808b7537b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537b17 expref: 16 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219292:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5c20ee000/0xa113d808b7537b1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537b17 expref: 16 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219301:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582699.219346:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:3312:x1874416186191616:12345-0@lo:103: Request processed in 83us (3419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582699.219351:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787582699.219361:0:5840:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787582699.219367:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787582699.219374:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5911a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:3313:x1874416186191232:12345-0@lo:103: 00010000:00010000:3.0:1787582699.219382:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582699.219392:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5c20efe00/0xa113d808b7537b80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537b79 expref: 14 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219400:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5c20efe00/0xa113d808b7537b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537b79 expref: 14 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219410:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5c20efe00/0xa113d808b7537b80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537b79 expref: 14 pid: 5846 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219421:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8da5c20efa00/0xa113d808b7537c21 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219429:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5c20efa00/0xa113d808b7537c21 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219442:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5c20efa00/0xa113d808b7537c21 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219449:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5c20efa00/0xa113d808b7537c21 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219454:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8da5c20efa00/0xa113d808b7537c21 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219461:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8da5c20efa00/0xa113d808b7537c21 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219467:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efa00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582699.219471:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8da5c20efa00/0xa113d808b7537c21 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219478:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8da5c20efa00/0xa113d808b7537c21 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219500:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8da5c20efa00/0xa113d808b7537c21 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.219511:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582699.219540:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5911a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:3313:x1874416186191232:12345-0@lo:103: Request processed in 167us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582699.219546:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787582699.221189:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186190976:0@lo:103: 00000100:00100000:3.0:1787582699.221203:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186191488:0@lo:103: 00010000:00010000:3.0:1787582699.221343:0:8458:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8da5c20efa00/0xa113d808b7537c21 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.221354:0:8458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8da5c20efa00/0xa113d808b7537c21 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582699.221361:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5c20efa00/0xa113d808b7537c21 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582699.221885:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186191104:0@lo:103: 00000100:00100000:0.0:1787582699.221896:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186191616:0@lo:103: 00010000:00010000:2.0:1787582699.222905:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582699.222978:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+12:3314:x1874416186190848:12345-0@lo:103: Request processed in 7544us (27416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582699.222989:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787582699.224468:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186191360:0@lo:103: 00000100:00100000:1.0:1787582699.224501:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186191232:0@lo:103: 00000100:00100000:1.0:1787582699.224520:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186190848:0@lo:103: 00010000:00010000:3.0:1787582699.984778:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582699.988439:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582699.988481:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582699.988500:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582699.988534:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582699.988582:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162050560 00000100:00100000:3.0:1787582699.988591:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162050560 00000100:00100000:3.0:1787582699.988660:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 26 00000100:00100000:3.0:1787582699.988669:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162050560:12345-192.168.206.20@tcp:400: 00000100:00100000:3.0:1787582699.989123:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162050560:12345-192.168.206.20@tcp:400: Request processed in 454us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582699.989132:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 26 00000100:00080000:0.0:1787582699.989429:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787582699.989847:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162050432 00000100:00100000:2.0:1787582699.989855:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162050432 00000100:00100000:2.0:1787582699.989905:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 131 00000100:00100000:2.0:1787582699.989914:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+8:2359:x1874416162050432:12345-192.168.206.20@tcp:400: 00000100:00100000:2.0:1787582699.989975:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+8:2359:x1874416162050432:12345-192.168.206.20@tcp:400: Request processed in 62us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582699.989994:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 131 00000100:00100000:1.0:1787582699.990145:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162050688 00000100:00100000:1.0:1787582699.990150:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162050688 00000100:00100000:1.0:1787582699.990201:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162050816 00000100:00100000:1.0:1787582699.990204:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162050816 00000100:00100000:1.0:1787582699.990229:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:1.0:1787582699.990236:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162050688:12345-192.168.206.20@tcp:400: 00000100:00100000:1.0:1787582699.990272:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162050688:12345-192.168.206.20@tcp:400: Request processed in 37us (1791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582699.990279:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:1.0:1787582699.990291:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:1.0:1787582699.990298:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162050816:12345-192.168.206.20@tcp:400: 00000100:00100000:1.0:1787582699.990344:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162050816:12345-192.168.206.20@tcp:400: Request processed in 46us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582699.990351:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00080000:0.0:1787582699.990564:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787582699.990573:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787582700.501656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582700.501746:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162050944 00000100:00100000:1.0:1787582700.501755:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162050944 00000100:00100000:1.0:1787582700.501813:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 132 00000100:00100000:1.0:1787582700.501824:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+8:5599:x1874416162050944:12345-192.168.206.20@tcp:101: 00010000:00010000:1.0:1787582700.501852:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582700.501870:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da581687000/0xa113d808b7537c28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57eeb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582700.501897:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da581687000/0xa113d808b7537c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57eeb expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582700.501908:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da581687000/0xa113d808b7537c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57eeb expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582700.501917:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da581687000, rc 0) 00000100:00100000:1.0:1787582700.501982:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:5599:x1874416162050944:12345-192.168.206.20@tcp:101: Request processed in 160us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582700.501990:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 132 00000100:00100000:0.0:1787582700.511449:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582700.511567:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162051072 00000100:00100000:3.0:1787582700.511587:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162051072 00000100:00100000:3.0:1787582700.511643:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 133 00000100:00100000:3.0:1787582700.511652:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589263c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:5599:x1874416162051072:12345-192.168.206.20@tcp:501: 00000100:00100000:3.0:1787582700.521196:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589263c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:5599:x1874416162051072:12345-192.168.206.20@tcp:501: Request processed in 9532us (9743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582700.521211:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 133 00000100:00100000:0.0:1787582700.530349:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582700.530448:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162051200 00000100:00100000:2.0:1787582700.530457:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162051200 00000100:00100000:2.0:1787582700.530513:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 134 00000100:00100000:2.0:1787582700.530523:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:5599:x1874416162051200:12345-192.168.206.20@tcp:503: 00000100:00100000:2.0:1787582700.530758:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:5599:x1874416162051200:12345-192.168.206.20@tcp:503: Request processed in 236us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582700.530767:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 134 00000100:00100000:0.0:1787582700.542154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582700.547252:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162051328 00000100:00100000:3.0:1787582700.547267:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162051328 00000100:00100000:3.0:1787582700.547355:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 135 00000100:00100000:3.0:1787582700.547365:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:6073:x1874416162051328:12345-192.168.206.20@tcp:502: 00000100:00100000:3.0:1787582700.547615:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:6073:x1874416162051328:12345-192.168.206.20@tcp:502: Request processed in 250us (5469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582700.547623:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 135 00000100:00100000:0.0:1787582700.563107:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582700.568848:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162051456 00000100:00100000:1.0:1787582700.568862:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162051456 00000100:00100000:1.0:1787582700.569007:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 136 00000100:00100000:1.0:1787582700.569019:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589263050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:6073:x1874416162051456:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787582700.569383:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589263050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:6073:x1874416162051456:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 366us (6284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582700.569391:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 136 00000100:00100000:0.0:1787582700.588052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582700.588987:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162051584 00000100:00100000:2.0:1787582700.588998:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162051584 00000100:00100000:2.0:1787582700.589107:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 137 00000100:00100000:2.0:1787582700.589117:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:5599:x1874416162051584:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582700.589132:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582700.589149:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4e9c200/0xa113d808b7537c2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57ef2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582700.589175:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4e9c200/0xa113d808b7537c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ef2 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582700.589186:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4e9c200/0xa113d808b7537c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ef2 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582700.589195:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9c200, rc 0) 00000100:00100000:2.0:1787582700.589255:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5599:x1874416162051584:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 Request processed in 139us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582700.589262:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 137 00000100:00100000:0.0:1787582700.595478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582700.610836:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162051712 00000100:00100000:1.0:1787582700.610851:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162051712 00000100:00100000:1.0:1787582700.610914:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 138 00000100:00100000:1.0:1787582700.610924:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5599:x1874416162051712:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582700.611198:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5599:x1874416162051712:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 Request processed in 274us (15727us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787582700.611216:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 138 00010000:00010000:2.0:1787582701.008501:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787582701.008652:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787582701.008657:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8da5bb7f0800 from 39 10000000:01000000:1.0:1787582701.008661:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787582701.008703:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.008714:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.008725:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582701.008748:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186191744:0@lo:101: 00000100:00100000:1.0:1787582701.008813:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582701.008874:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582701.008950:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186191744 00000100:00100000:2.0:1787582701.008967:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186191744 00000100:00100000:2.0:1787582701.009017:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787582701.009027:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+12:5851:x1874416186191744:12345-0@lo:101: 00010000:00010000:2.0:1787582701.009039:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582701.009051:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4e9c400/0xa113d808b7537c3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537c36 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.009072:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4e9c400/0xa113d808b7537c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537c36 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.009081:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4e9c400/0xa113d808b7537c3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537c36 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.009090:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9c400, rc 0) 00000100:00100000:2.0:1787582701.009134:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:5851:x1874416186191744:12345-0@lo:101: Request processed in 108us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582701.009141:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787582701.009384:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186191744:0@lo:101: 00010000:00010000:1.0:1787582701.009409:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c3d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.009419:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537c3d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582701.009470:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186191872:0@lo:501: 00000100:00100000:1.0:1787582701.009496:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582701.009525:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582701.009639:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186191872 00000100:00100000:2.0:1787582701.009644:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186191872 00000100:00100000:2.0:1787582701.009677:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787582701.009684:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:5851:x1874416186191872:12345-0@lo:501: 00000100:00100000:2.0:1787582701.009920:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+13:5851:x1874416186191872:12345-0@lo:501: Request processed in 235us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582701.010347:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787582701.011666:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186191872:0@lo:501: 00000100:00100000:3.0:1787582701.011717:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186192000:0@lo:503: 00000100:00100000:3.0:1787582701.011781:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582701.011822:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c7e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582701.012113:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186192000 00000100:00100000:1.0:1787582701.012119:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186192000 00000100:00100000:1.0:1787582701.012182:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787582701.012191:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:5851:x1874416186192000:12345-0@lo:503: 00000100:00100000:1.0:1787582701.012408:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:5851:x1874416186192000:12345-0@lo:503: Request processed in 218us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582701.012415:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787582701.012559:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186192000:0@lo:503: 00000100:00100000:0.0:1787582701.015229:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8476:1874416186192128:0@lo:502: 00000100:00100000:0.0:1787582701.015305:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582701.015377:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf718840 going to sleep for 11 seconds 00000100:00100000:1.0:1787582701.015690:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186192128 00000100:00100000:1.0:1787582701.015698:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186192128 00000100:00100000:1.0:1787582701.015743:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787582701.015752:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:8476:x1874416186192128:12345-0@lo:502: 00000100:00100000:1.0:1787582701.016019:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:8476:x1874416186192128:12345-0@lo:502: Request processed in 267us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582701.016027:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787582701.016190:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8476:1874416186192128:0@lo:502: 00000100:00100000:3.0:1787582701.016249:0:8476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8476:1874416186192256:0@lo:502: 00000100:00100000:3.0:1787582701.016283:0:8476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582701.016305:0:8476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c7e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582701.016527:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186192256 00000100:00100000:1.0:1787582701.016532:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186192256 00000100:00100000:1.0:1787582701.016554:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787582701.016561:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:8476:x1874416186192256:12345-0@lo:502: 00000100:00100000:1.0:1787582701.016708:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:8476:x1874416186192256:12345-0@lo:502: Request processed in 147us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582701.016715:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787582701.018071:0:8476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8476:1874416186192256:0@lo:502: 00000040:00080000:3.0:1787582701.018105:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787582701.018516:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787582701.018535:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787582701.018544:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c3d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.018556:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c3d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582701.018565:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787582701.018574:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787582701.018577:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787582701.018605:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.018613:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.018623:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582701.018640:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186192384:0@lo:101: 00000100:00100000:1.0:1787582701.018687:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582701.018726:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787582701.018789:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186192384 00000100:00100000:2.0:1787582701.018795:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186192384 00000100:00100000:2.0:1787582701.018837:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787582701.018852:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+13:5851:x1874416186192384:12345-0@lo:101: 00010000:00010000:2.0:1787582701.018863:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582701.018875:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4e9cc00/0xa113d808b7537c4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537c44 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.018897:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4e9cc00/0xa113d808b7537c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537c44 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.018906:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4e9cc00/0xa113d808b7537c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537c44 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.018914:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9cc00, rc 0) 00000100:00100000:2.0:1787582701.018977:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:5851:x1874416186192384:12345-0@lo:101: Request processed in 127us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582701.018983:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787582701.019183:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186192384:0@lo:101: 00010000:00010000:1.0:1787582701.019197:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.019205:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537c4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582701.019258:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186192512:0@lo:501: 00000100:00100000:1.0:1787582701.019281:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582701.019302:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787582701.019583:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186192512 00000100:00100000:2.0:1787582701.019588:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186192512 00000100:00100000:2.0:1787582701.019619:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787582701.019626:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+14:5851:x1874416186192512:12345-0@lo:501: 00000100:00100000:2.0:1787582701.019872:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+14:5851:x1874416186192512:12345-0@lo:501: Request processed in 246us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582701.019879:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787582701.019968:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186192512:0@lo:501: 00000100:00100000:3.0:1787582701.019996:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186192640:0@lo:503: 00000100:00100000:3.0:1787582701.020035:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582701.020066:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c7e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582701.020187:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186192640 00000100:00100000:0.0:1787582701.020192:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186192640 00000100:00100000:0.0:1787582701.020222:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787582701.020230:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:5851:x1874416186192640:12345-0@lo:503: 00000100:00100000:3.0:1787582701.020633:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186192640:0@lo:503: 00000100:00100000:0.0:1787582701.020763:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+14:5851:x1874416186192640:12345-0@lo:503: Request processed in 533us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582701.020769:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787582701.021752:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8477:1874416186192768:0@lo:502: 00000100:00100000:2.0:1787582701.021801:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582701.021836:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da48364e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582701.021892:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186192768 00000100:00100000:0.0:1787582701.021898:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186192768 00000100:00100000:2.0:1787582701.022027:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787582701.022035:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+14:8477:x1874416186192768:12345-0@lo:502: 00000100:00100000:2.0:1787582701.022526:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+14:8477:x1874416186192768:12345-0@lo:502: Request processed in 358us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582701.022540:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787582701.022750:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8477:1874416186192768:0@lo:502: 00000020:01000000:1.0:1787582701.022776:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582701.022785:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582701.022787:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787582701.022792:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787582701.022823:0:8477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8477:1874416186192896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582701.022859:0:8477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582701.022879:0:8477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582701.023028:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186192896 00000100:00100000:2.0:1787582701.023033:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186192896 00000100:00100000:2.0:1787582701.023108:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787582701.023116:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:8477:x1874416186192896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582701.023283:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:8477:x1874416186192896:12345-0@lo:502:llog_process_th.0 Request processed in 167us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582701.023290:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787582701.023366:0:8477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8477:1874416186192896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787582701.023387:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582701.023392:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582701.023405:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787582701.023409:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787582701.024226:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787582701.024247:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787582701.024257:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582701.024267:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582701.024276:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787582701.024279:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8da5a1567000 from 39 10000000:01000000:3.0:1787582701.024282:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787582701.024309:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582701.024345:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582701.024354:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582701.024372:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186193024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787582701.024423:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582701.044272:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c7e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582701.049700:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186193024 00000100:00100000:0.0:1787582701.049716:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186193024 00000100:00100000:0.0:1787582701.049774:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787582701.049784:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+14:5851:x1874416186193024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787582701.049800:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582701.049816:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da580030a00/0xa113d808b7537c59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537c52 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582701.049841:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da580030a00/0xa113d808b7537c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537c52 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582701.049868:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da580030a00/0xa113d808b7537c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537c52 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582701.049875:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580030a00, rc 0) 00000100:00100000:0.0:1787582701.049977:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+15:5851:x1874416186193024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (25553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582701.049983:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787582701.050098:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186193024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582701.050115:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.050124:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537c59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582701.050200:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186193152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582701.050257:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582701.050289:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787582701.050752:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186193152 00000100:00100000:0.0:1787582701.050757:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186193152 00000100:00100000:0.0:1787582701.050781:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1787582701.050787:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+15:5851:x1874416186193152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582701.051039:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+15:5851:x1874416186193152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582701.051046:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787582701.051130:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186193152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582701.051161:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186193280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582701.051207:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582701.051252:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787582701.051631:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186193280 00000100:00100000:0.0:1787582701.051637:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186193280 00000100:00100000:0.0:1787582701.051659:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787582701.051665:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+15:5851:x1874416186193280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582701.051817:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+15:5851:x1874416186193280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582701.051824:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787582701.051911:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186193280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582701.052644:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8478:1874416186193408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582701.052690:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582701.052730:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787582701.052780:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186193408 00000100:00100000:0.0:1787582701.052785:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186193408 00000100:00100000:0.0:1787582701.052808:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787582701.052816:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+15:8478:x1874416186193408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582701.053036:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+15:8478:x1874416186193408:12345-0@lo:502:llog_process_th.0 Request processed in 219us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582701.053042:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787582701.053255:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8478:1874416186193408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582701.053296:0:8478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8478:1874416186193536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582701.053355:0:8478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582701.053367:0:8478:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787582701.053750:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186193536 00000100:00100000:0.0:1787582701.053755:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186193536 00000100:00100000:0.0:1787582701.053777:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787582701.053783:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+15:8478:x1874416186193536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582701.053944:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+15:8478:x1874416186193536:12345-0@lo:502:llog_process_th.0 Request processed in 160us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582701.053950:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787582701.055051:0:8478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8478:1874416186193536:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787582701.055083:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787582701.057448:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787582701.057480:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787582701.057490:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582701.057503:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582701.057512:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787582701.057515:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787582701.057518:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787582701.057553:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582701.057573:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582701.057585:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582701.057619:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186193664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787582701.057680:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582701.057735:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58a9a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582701.059765:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186193664 00000100:00100000:1.0:1787582701.059786:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186193664 00000100:00100000:1.0:1787582701.059833:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787582701.059842:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+15:5851:x1874416186193664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582701.059856:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582701.059873:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da581686800/0xa113d808b7537c67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537c60 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.059897:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da581686800/0xa113d808b7537c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537c60 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.059906:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da581686800/0xa113d808b7537c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537c60 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.059913:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da581686800, rc 0) 00000100:00100000:1.0:1787582701.059983:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186193664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582701.059989:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787582701.061196:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186193664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787582701.061227:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582701.061238:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537c67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582701.061305:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186193792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582701.061375:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582701.061495:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186193792 00000100:00100000:1.0:1787582701.061501:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186193792 00000100:00100000:1.0:1787582701.061537:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787582701.061544:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186193792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582701.061917:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58a9a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582701.067065:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186193792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5514us (5682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582701.067079:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787582701.071473:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186193792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582701.071997:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186193920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582701.072071:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582701.072112:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787582701.072168:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186193920 00000100:00100000:2.0:1787582701.072175:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186193920 00000100:00100000:2.0:1787582701.072237:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787582701.072247:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186193920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582701.072468:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186193920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 221us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582701.072475:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787582701.072814:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186193920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582701.073624:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb683100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8479:1874416186194048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582701.073673:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582701.073741:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58565c600 going to sleep for 11 seconds 00000100:00100000:1.0:1787582701.074870:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186194048 00000100:00100000:1.0:1787582701.074879:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186194048 00000100:00100000:1.0:1787582701.074932:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787582701.074941:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:8479:x1874416186194048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582701.075164:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:8479:x1874416186194048:12345-0@lo:502:llog_process_th.0 Request processed in 223us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582701.075172:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787582701.075424:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb683100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8479:1874416186194048:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787582701.075456:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787582701.075466:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582701.075469:0:8479:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787582701.075474:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787582701.075502:0:8479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb683100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8479:1874416186194176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582701.075541:0:8479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582701.075588:0:8479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b618d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582701.075701:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186194176 00000100:00100000:3.0:1787582701.075706:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186194176 00000100:00100000:3.0:1787582701.075736:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787582701.075744:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:8479:x1874416186194176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582701.075880:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:8479:x1874416186194176:12345-0@lo:502:llog_process_th.0 Request processed in 136us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582701.075886:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787582701.082890:0:8479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb683100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8479:1874416186194176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787582701.082938:0:8479:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582701.082949:0:8479:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582701.082951:0:8479:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787582701.082965:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1787582701.083389:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787582701.083418:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787582701.083429:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.083441:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582701.083450:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787582701.083453:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8da584c3b800 from 39 10000000:01000000:1.0:1787582701.083455:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787582701.083497:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.083505:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.083513:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582701.083533:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186194304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787582701.083592:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582701.083624:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5884a7840 going to sleep for 11 seconds 00000100:00100000:0.0:1787582701.083806:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186194304 00000100:00100000:0.0:1787582701.083813:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186194304 00000100:00100000:0.0:1787582701.083861:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787582701.083870:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186194304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787582701.083882:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582701.083895:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da580031600/0xa113d808b7537c75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537c6e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582701.083915:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da580031600/0xa113d808b7537c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537c6e expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582701.083925:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da580031600/0xa113d808b7537c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537c6e expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582701.083934:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580031600, rc 0) 00000100:00100000:0.0:1787582701.083990:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186194304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582701.083996:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787582701.084085:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186194304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582701.084099:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.084109:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537c75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582701.084154:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186194432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582701.084181:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582701.084220:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da48364e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582701.084313:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186194432 00000100:00100000:0.0:1787582701.084344:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186194432 00000100:00100000:0.0:1787582701.084367:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787582701.084373:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186194432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582701.084606:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186194432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582701.084619:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787582701.084805:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186194432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582701.084842:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186194560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582701.084878:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582701.084908:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da48364e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582701.084921:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186194560 00000100:00100000:2.0:1787582701.084925:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186194560 00000100:00100000:2.0:1787582701.084946:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787582701.084952:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186194560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582701.085093:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186194560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582701.085099:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787582701.085126:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186194560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582701.085298:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8480:1874416186194688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582701.085358:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582701.085375:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186194688 00000100:00100000:2.0:1787582701.085378:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186194688 00000100:00100000:2.0:1787582701.085515:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787582701.085523:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:8480:x1874416186194688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582701.085663:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:8480:x1874416186194688:12345-0@lo:502:llog_process_th.0 Request processed in 141us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582701.085670:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787582701.085697:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da48364e480 going to sleep for 11 seconds 00000100:00100000:2.0:1787582701.085709:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8480:1874416186194688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582701.085746:0:8480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8480:1874416186194816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582701.085777:0:8480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582701.085804:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186194816 00000100:00100000:2.0:1787582701.085807:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186194816 00000100:00100000:2.0:1787582701.085823:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787582701.085829:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:8480:x1874416186194816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582701.085946:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:8480:x1874416186194816:12345-0@lo:502:llog_process_th.0 Request processed in 117us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582701.085953:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787582701.085989:0:8480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58b34d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787582701.086000:0:8480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8480:1874416186194816:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787582701.086019:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787582701.086063:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787582701.086078:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787582701.086086:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.086094:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582701.086102:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787582701.086104:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787582701.086106:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787582701.086125:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.088294:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.088553:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582701.088598:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186194944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787582701.088656:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582701.088736:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58b34d180 going to sleep for 11 seconds 00000100:00100000:0.0:1787582701.096815:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186194944 00000100:00100000:0.0:1787582701.096829:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186194944 00000100:00100000:1.0:1787582701.096950:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787582701.096969:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186194944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582701.096985:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582701.097002:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da581686400/0xa113d808b7537c83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537c7c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.097029:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da581686400/0xa113d808b7537c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537c7c expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.097040:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da581686400/0xa113d808b7537c83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537c7c expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.097048:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da581686400, rc 0) 00000100:00100000:1.0:1787582701.097115:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186194944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (8457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582701.097121:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787582701.097597:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186194944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582701.097614:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.097624:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537c83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582701.097684:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186195072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582701.097716:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582701.097750:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58b34d180 going to sleep for 11 seconds 00000100:00100000:1.0:1787582701.099566:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186195072 00000100:00100000:1.0:1787582701.099590:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186195072 00000100:00100000:1.0:1787582701.099633:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787582701.099641:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186195072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582701.099989:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186195072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 348us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582701.099997:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787582701.108671:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186195072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582701.119572:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186195200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582701.119657:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582701.119739:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58b34dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787582701.130099:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186195200 00000100:00100000:0.0:1787582701.130113:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186195200 00000100:00100000:1.0:1787582701.130270:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787582701.130281:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186195200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582701.130556:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186195200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 276us (10898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582701.130565:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787582701.130883:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186195200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582701.131721:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8481:1874416186195328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582701.131788:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582701.131825:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8c7e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787582701.131933:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186195328 00000100:00100000:2.0:1787582701.131940:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186195328 00000100:00100000:2.0:1787582701.131992:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787582701.132000:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:8481:x1874416186195328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582701.132202:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:8481:x1874416186195328:12345-0@lo:502:llog_process_th.0 Request processed in 203us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582701.132217:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787582701.132366:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8481:1874416186195328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787582701.132391:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787582701.132411:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582701.132413:0:8481:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787582701.132419:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787582701.132441:0:8481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb683100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8481:1874416186195456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582701.132476:0:8481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582701.132498:0:8481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b618dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582701.132662:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186195456 00000100:00100000:2.0:1787582701.132668:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186195456 00000100:00100000:2.0:1787582701.132706:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787582701.132714:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:8481:x1874416186195456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582701.132856:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:8481:x1874416186195456:12345-0@lo:502:llog_process_th.0 Request processed in 142us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582701.132862:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787582701.132998:0:8481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb683100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8481:1874416186195456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787582701.133018:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582701.133022:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582701.133023:0:8481:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787582701.133027:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787582701.133610:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787582701.133627:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787582701.133637:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.133647:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582701.133657:0:5851:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787582701.133660:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8da588590000 from 1 10000000:01000000:2.0:1787582701.133662:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787582701.133689:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d200/0xa113d808b7537c8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.133697:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d200/0xa113d808b7537c8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.133706:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d200/0xa113d808b7537c8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582701.133721:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186195584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787582701.133753:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582701.133791:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a030ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787582701.133894:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186195584 00000100:00100000:1.0:1787582701.133900:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186195584 00000100:00100000:1.0:1787582701.133934:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787582701.133942:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186195584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582701.133950:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582701.133970:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da581687a00/0xa113d808b7537c91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537c8a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.133989:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da581687a00/0xa113d808b7537c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537c8a expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.133999:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da581687a00/0xa113d808b7537c91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537c8a expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582701.134007:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da581687a00, rc 0) 00000100:00100000:1.0:1787582701.134050:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186195584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582701.134064:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787582701.135385:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186195584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582701.135428:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d200/0xa113d808b7537c8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c91 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.135438:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d200/0xa113d808b7537c8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537c91 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582701.135493:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186195712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582701.135529:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582701.135564:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a030ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787582701.135695:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186195712 00000100:00100000:3.0:1787582701.135701:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186195712 00000100:00100000:3.0:1787582701.135742:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787582701.135750:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186195712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582701.135987:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186195712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (456us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787582701.135995:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787582701.136232:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186195712:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1787582701.136253:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787582701.136260:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d200/0xa113d808b7537c8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c91 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582701.136268:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d200/0xa113d808b7537c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c91 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582701.650695:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186195840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582701.650765:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582701.650991:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186195840 00000100:00100000:0.0:1787582701.650999:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186195840 00000100:00100000:0.0:1787582701.651062:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787582701.651071:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186195840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787582701.651105:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582701.651156:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186195840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582701.651164:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787582701.651262:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb6e7480 x1874416186195840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582717 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582701.651279:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186195840:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787582701.655640:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787582702.036914:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787582702.425108:0:8518:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0f010f90 20000000:00000080:2.0:1787582702.425129:0:8518:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8da5bf8d0000 uarg=0000000000000000 20000000:01000000:2.0:1787582702.425163:0:8518:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787582702.425168:0:8518:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787582702.425173:0:8518:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787582702.426278:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787582702.426472:0:8518:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787582702.431524:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787582702.431577:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787582702.431630:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787582702.431648:0:8518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787582702.431665:0:8518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537c98 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582702.431687:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5c20eee00/0xa113d808b7537a84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537a7d expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582702.431694:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da58147fa00/0xa113d808b7537aae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537aa7 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582702.431700:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da580031e00/0xa113d808b7537b3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537b33 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582702.431708:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5b4e9dc00/0xa113d808b7537bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57eba expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582702.431715:0:8518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537c98 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582702.431749:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5b4e9dc00/0xa113d808b7537bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57eba expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582702.431762:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da5b4e9dc00/0xa113d808b7537bf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57eba expref: 9 pid: 5848 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582702.431775:0:8518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1874416186195968:192.168.206.20@tcp:104: 00010000:00010000:2.0:1787582702.431866:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da580031e00/0xa113d808b7537b3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537b33 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582702.431874:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da580031e00/0xa113d808b7537b3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537b33 expref: 18 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582702.431882:0:8518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1874416186196096:0@lo:104: 00000100:00100000:2.0:1787582702.431943:0:8518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582702.431989:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da58147fa00/0xa113d808b7537aae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537aa7 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582702.431998:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da58147fa00/0xa113d808b7537aae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537aa7 expref: 18 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582702.432006:0:8518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1874416186196224:0@lo:104: 00010000:00010000:2.0:1787582702.432030:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5c20eee00/0xa113d808b7537a84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537a7d expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582702.432037:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da5c20eee00/0xa113d808b7537a84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537a7d expref: 18 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582702.432043:0:8518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1874416186196352:0@lo:104: 00000100:00100000:2.0:1787582702.432058:0:8518:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da588484900 going to sleep for 11 seconds 00000100:00100000:1.0:1787582702.432202:0:5836:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787582702.432221:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582702.432249:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582702.432258:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186196096 00000100:00100000:1.0:1787582702.432264:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186196096 00000100:00100000:1.0:1787582702.432298:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186196224 00000100:00100000:1.0:1787582702.432301:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186196224 00000100:00100000:1.0:1787582702.432311:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186196352 00000100:00100000:1.0:1787582702.432313:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186196352 00000100:00100000:1.0:1787582702.432350:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787582702.432358:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+5:8518:x1874416186196096:12345-0@lo:104: 00010000:00010000:1.0:1787582702.432369:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da581686c00/0xa113d808b7537b33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537b3a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432418:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787582702.432423:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+5:8518:x1874416186196096:12345-0@lo:104: Request processed in 67us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582702.432430:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787582702.432461:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787582702.432467:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+4:8518:x1874416186196224:12345-0@lo:104: 00010000:00010000:1.0:1787582702.432474:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da581687600/0xa113d808b7537aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537aae expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432505:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787582702.432516:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+4:8518:x1874416186196224:12345-0@lo:104: Request processed in 50us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582702.432522:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787582702.432533:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787582702.432538:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:8518:x1874416186196352:12345-0@lo:104: 00010000:00010000:1.0:1787582702.432544:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7537a7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537a84 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432570:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787582702.432574:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:8518:x1874416186196352:12345-0@lo:104: Request processed in 36us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582702.432578:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1787582702.432594:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787582702.432599:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da581686c00/0xa113d808b7537b33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537b3a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432605:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581686c00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1787582702.432609:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da581686c00/0xa113d808b7537b33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537b3a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432616:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da581686c00/0xa113d808b7537b33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537b3a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582702.432623:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da581686c00/0xa113d808b7537b33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537b3a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582702.432629:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787582702.432661:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da581686c00/0xa113d808b7537b33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b3a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432686:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582702.432718:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da581686c00/0xa113d808b7537b33 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b3a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432728:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da581686c00/0xa113d808b7537b33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537b3a expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432748:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787582702.432753:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da581687600/0xa113d808b7537aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537aae expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432764:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581687600 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1787582702.432768:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da581687600/0xa113d808b7537aa7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537aae expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432777:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da581687600/0xa113d808b7537aa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537aae expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582702.432786:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da581687600/0xa113d808b7537aa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537aae expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582702.432791:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787582702.432803:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da581687600/0xa113d808b7537aa7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537aae expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432809:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582702.432822:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da581687600/0xa113d808b7537aa7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537aae expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432828:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da581687600/0xa113d808b7537aa7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537aae expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432847:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582702.432853:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7537a7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537a84 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432862:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee200 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1787582702.432867:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7537a7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537a84 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432877:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7537a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537a84 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582702.432889:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7537a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537a84 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582702.432897:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787582702.432917:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7537a7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537a84 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432933:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582702.432940:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7537a7d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537a84 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432957:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7537a7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537a84 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582702.432969:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582702.432971:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582702.432973:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582702.432979:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582702.433005:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186196480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787582702.433036:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582702.433067:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186196608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787582702.433087:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582702.433102:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787582702.433107:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186196736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787582702.433125:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582702.433272:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186196480 00000100:00100000:3.0:1787582702.433280:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186196480 00010000:00010000:3.0:1787582702.433354:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da580031e00/0xa113d808b7537b3a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537b33 expref: 19 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582702.433388:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186196608 00000100:00100000:3.0:1787582702.433394:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186196608 00010000:00010000:3.0:1787582702.433410:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da58147fa00/0xa113d808b7537aae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537aa7 expref: 20 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582702.433428:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186196736 00000100:00100000:3.0:1787582702.433431:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186196736 00010000:00010000:3.0:1787582702.433446:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5c20eee00/0xa113d808b7537a84 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537a7d expref: 21 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582702.433465:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787582702.433475:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+21:3314:x1874416186196480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787582702.433489:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582702.433497:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da580031e00/0xa113d808b7537b3a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537b33 expref: 21 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.433514:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da580031e00/0xa113d808b7537b3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537b33 expref: 21 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.433536:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582702.433580:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+21:3314:x1874416186196480:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582702.433591:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787582702.433611:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787582702.433620:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+20:3311:x1874416186196608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787582702.433629:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582702.433636:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da58147fa00/0xa113d808b7537aae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537aa7 expref: 20 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.433658:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da58147fa00/0xa113d808b7537aae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537aa7 expref: 20 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.433672:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582702.433708:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+20:3311:x1874416186196608:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582702.433717:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787582702.433735:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787582702.433745:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186196736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787582702.433754:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582702.433761:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5c20eee00/0xa113d808b7537a84 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537a7d expref: 19 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.433774:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5c20eee00/0xa113d808b7537a84 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537a7d expref: 19 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.433783:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582702.433802:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186196736:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582702.433808:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1787582702.433863:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da580031e00/0xa113d808b7537b3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537b33 expref: 18 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582702.433879:0:8518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1874416186196096:0@lo:104: 00010000:00010000:3.0:1787582702.433895:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da58147fa00/0xa113d808b7537aae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537aa7 expref: 17 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582702.433909:0:8518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1874416186196224:0@lo:104: 00010000:00010000:3.0:1787582702.433957:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5c20eee00/0xa113d808b7537a84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537a7d expref: 16 pid: 5848 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582702.434035:0:8518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1874416186196352:0@lo:104: 00000100:00100000:1.0:1787582702.435114:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186196480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787582702.435186:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186196736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787582702.435211:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186196608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787582702.438615:0:8518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1874416186195968:192.168.206.20@tcp:104: 00010000:00010000:2.0:1787582702.438646:0:8518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537c98 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582702.438891:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582702.438961:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162051840 00000100:00100000:3.0:1787582702.438968:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162051840 00010000:00010000:3.0:1787582702.439002:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5b4e9dc00/0xa113d808b7537bf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57eba expref: 10 pid: 5848 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582702.439041:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 24 00000100:00100000:3.0:1787582702.439050:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb683100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2360:x1874416162051840:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582702.439064:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582702.439070:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5b4e9dc00/0xa113d808b7537bf7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57eba expref: 10 pid: 5848 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.439082:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5b4e9dc00/0xa113d808b7537bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57eba expref: 10 pid: 5848 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.439099:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4e9dc00/0xa113d808b7537bf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57eba expref: 10 pid: 5848 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.439114:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537c98 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.439122:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537c98 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.439137:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537c98 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.439198:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537c98 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.439204:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537c98 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.439210:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537c98 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.439215:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9d600 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582702.439219:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537c98 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.439227:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537c98 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.439250:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537c98 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582702.439259:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582702.439339:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb683100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:2360:x1874416162051840:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 266us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582702.439347:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 24 00010000:00010000:2.0:1787582702.440684:0:8518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537c98 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582702.440696:0:8518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537c98 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582702.440702:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537c98 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582702.672607:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186197248:0@lo:400:kworker.0 00000100:00100000:2.0:1787582702.672689:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582702.672750:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787582702.672757:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186197120:0@lo:400:kworker.0 00000100:00100000:2.0:1787582702.672781:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582702.672809:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186197248 00000100:00100000:2.0:1787582702.672815:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186197248 00000100:00100000:2.0:1787582702.672856:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186197120 00000100:00100000:2.0:1787582702.672858:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186197120 00000100:00100000:2.0:1787582702.672877:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787582702.672883:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186197248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582702.673094:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787582702.673105:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186197120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582702.673162:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186196864:0@lo:400:kworker.0 00000100:00100000:3.0:1787582702.673242:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186196992:0@lo:400:kworker.0 00000100:00100000:0.0:1787582702.674518:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186197120:12345-0@lo:400:kworker.0 Request processed in 1409us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582702.674529:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787582702.674562:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582702.676357:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582702.676398:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186197376:0@lo:400:kworker.0 00000100:00100000:1.0:1787582702.676438:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582702.676600:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186196864 00000100:00100000:0.0:1787582702.676608:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186196864 00000100:00100000:0.0:1787582702.676656:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787582702.676665:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186196864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582702.676718:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186196864:12345-0@lo:400:kworker.0 Request processed in 54us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582702.676724:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787582702.676763:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186196864:0@lo:400:kworker.0 00000100:00100000:2.0:1787582702.677977:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186197248:12345-0@lo:400:kworker.0 Request processed in 5087us (5282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582702.677987:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787582702.678046:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186197120:0@lo:400:kworker.0 00000100:00100000:2.0:1787582702.678059:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186197248:0@lo:400:kworker.0 00000100:00100000:2.0:1787582702.678100:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186197376 00000100:00100000:2.0:1787582702.678105:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186197376 00000100:00100000:2.0:1787582702.678157:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787582702.678165:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186197376:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787582702.678302:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787582702.678455:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186197376:12345-0@lo:400:kworker.0 Request processed in 290us (2016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582702.678461:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787582702.678557:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb6e5500 x1874416186197376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582702.678568:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186197376:0@lo:400:kworker.0 00000100:00100000:0.0:1787582702.679098:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582702.680788:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186196992 00000100:00100000:1.0:1787582702.680801:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186196992 00000100:00100000:1.0:1787582702.680862:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787582702.680872:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186196992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582702.680963:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186196992:12345-0@lo:400:kworker.0 Request processed in 93us (1865us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582702.680970:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787582702.681149:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb6e6d80 x1874416186196992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582702.681165:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186196992:0@lo:400:kworker.0 00010000:00010000:0.0:1787582703.064076:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582703.187579:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582703.190608:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186197504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582703.190677:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582703.190809:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186197504 00000100:00100000:0.0:1787582703.190822:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186197504 00000100:00100000:0.0:1787582703.190895:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787582703.190904:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186197504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787582703.190936:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582703.190988:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186197504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582703.190995:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787582703.191054:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb6e6300 x1874416186197504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582703.191072:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186197504:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1787582703.568410:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787582703.568417:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da5bb7f0800 from 4 10000000:01000000:1.0:1787582703.568422:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787582703.568463:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b6200/0xa113d808b7537c9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582703.568474:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b6200/0xa113d808b7537c9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582703.568486:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b6200/0xa113d808b7537c9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582703.568509:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186197632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787582703.568571:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582703.568622:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5884bf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582703.568689:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186197632 00000100:00100000:2.0:1787582703.568696:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186197632 00000100:00100000:2.0:1787582703.568741:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787582703.568750:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186197632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582703.568774:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582703.568786:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4e9de00/0xa113d808b7537ca6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537c9f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.568807:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4e9de00/0xa113d808b7537ca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537c9f expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.568817:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4e9de00/0xa113d808b7537ca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537c9f expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.568826:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9de00, rc 0) 00000100:00100000:2.0:1787582703.568872:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186197632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582703.568878:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787582703.569020:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186197632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582703.569035:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b6200/0xa113d808b7537c9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582703.569043:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b6200/0xa113d808b7537c9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582703.569089:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186197760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582703.569119:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582703.571077:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5884bf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582703.574365:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186197760 00000100:00100000:2.0:1787582703.574376:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186197760 00000100:00100000:2.0:1787582703.574421:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787582703.574429:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186197760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.574677:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186197760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (5557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582703.574685:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787582703.574733:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186197760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.574778:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186197888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.574821:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582703.574848:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da588484240 going to sleep for 11 seconds 00000100:00100000:2.0:1787582703.574875:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186197888 00000100:00100000:2.0:1787582703.574879:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186197888 00000100:00100000:2.0:1787582703.574909:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787582703.574915:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186197888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.575060:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186197888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582703.575067:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787582703.575104:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186197888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.575256:0:8572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8572:1874416186198016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582703.575288:0:8572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582703.575306:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186198016 00000100:00100000:2.0:1787582703.575309:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186198016 00000100:00100000:2.0:1787582703.575353:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787582703.575360:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:8572:x1874416186198016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582703.575470:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:8572:x1874416186198016:12345-0@lo:502:llog_process_th.0 Request processed in 111us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582703.575476:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787582703.575501:0:8572:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5884840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582703.575513:0:8572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8572:1874416186198016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787582703.575531:0:8572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582703.575539:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582703.575542:0:8572:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787582703.575548:0:8572:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8da5bb7f0800 00000020:00000080:2.0:1787582703.575550:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787582703.595671:0:8572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8572:1874416186198144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582703.595752:0:8572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582703.595790:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186198144 00000100:00100000:2.0:1787582703.595803:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186198144 00000100:00100000:2.0:1787582703.595850:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787582703.595859:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:8572:x1874416186198144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582703.596061:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:8572:x1874416186198144:12345-0@lo:502:llog_process_th.0 Request processed in 202us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582703.596068:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787582703.596128:0:8572:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5884840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582703.596147:0:8572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8572:1874416186198144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787582703.596175:0:8572:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582703.596182:0:8572:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582703.596184:0:8572:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787582703.596188:0:8572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787582703.596243:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787582703.596260:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787582703.596269:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b6200/0xa113d808b7537c9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.596281:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b6200/0xa113d808b7537c9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582703.596677:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787582703.596681:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da5a1567000 from 4 10000000:01000000:2.0:1787582703.596684:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787582703.596710:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d400/0xa113d808b7537cad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.596719:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d400/0xa113d808b7537cad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.596727:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d400/0xa113d808b7537cad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582703.596749:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186198272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.596783:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582703.596802:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5884840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582703.596817:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186198272 00000100:00100000:2.0:1787582703.596822:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186198272 00000100:00100000:2.0:1787582703.596846:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787582703.596853:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186198272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582703.596862:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582703.596873:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4e9c000/0xa113d808b7537cb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537cad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.596894:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4e9c000/0xa113d808b7537cb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537cad expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.596903:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4e9c000/0xa113d808b7537cb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537cad expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.596912:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9c000, rc 0) 00000100:00100000:2.0:1787582703.596952:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186198272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582703.596959:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787582703.596993:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186198272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582703.597004:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d400/0xa113d808b7537cad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537cb4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.597012:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d400/0xa113d808b7537cad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537cb4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582703.597060:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186198400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.597084:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582703.597097:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5884840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582703.597109:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186198400 00000100:00100000:2.0:1787582703.597112:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186198400 00000100:00100000:2.0:1787582703.597133:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787582703.597139:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186198400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.602582:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186198400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5438us (5492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582703.602595:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787582703.602654:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186198400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.602703:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186198528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.602751:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582703.602770:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5884840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582703.602788:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186198528 00000100:00100000:2.0:1787582703.602793:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186198528 00000100:00100000:2.0:1787582703.602825:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787582703.602833:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186198528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.603004:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186198528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582703.603011:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787582703.603048:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186198528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582703.607465:0:8576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb680000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8576:1874416186198656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582703.607551:0:8576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582703.607590:0:8576:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787582703.612367:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186198656 00000100:00100000:2.0:1787582703.612389:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186198656 00000100:00100000:2.0:1787582703.612434:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787582703.612443:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:8576:x1874416186198656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582703.612675:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:8576:x1874416186198656:12345-0@lo:502:llog_process_th.0 Request processed in 233us (5124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582703.612683:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787582703.612744:0:8576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb680000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8576:1874416186198656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787582703.612775:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582703.612784:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582703.612786:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787582703.612793:0:8576:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8da5a1567000 00000020:00000080:2.0:1787582703.612796:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787582703.612884:0:8576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8576:1874416186198784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582703.612927:0:8576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582703.612964:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186198784 00000100:00100000:2.0:1787582703.612968:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186198784 00000100:00100000:2.0:1787582703.612990:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787582703.612996:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:8576:x1874416186198784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582703.613100:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:8576:x1874416186198784:12345-0@lo:502:llog_process_th.0 Request processed in 103us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582703.613106:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787582703.613138:0:8576:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5830c8300 going to sleep for 11 seconds 00000100:00100000:2.0:1787582703.613150:0:8576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8576:1874416186198784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787582703.613165:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582703.613169:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582703.613171:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787582703.613174:0:8576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787582703.613227:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787582703.613242:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787582703.613252:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d400/0xa113d808b7537cad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537cb4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.613262:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d400/0xa113d808b7537cad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537cb4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582703.613272:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787582703.613275:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da584c3b800 from 4 10000000:01000000:2.0:1787582703.613277:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787582703.613299:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537cbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.613307:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537cbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.613359:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537cbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582703.613372:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186198912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.613400:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582703.613416:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5830c8300 going to sleep for 11 seconds 00000100:00100000:2.0:1787582703.613429:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186198912 00000100:00100000:2.0:1787582703.613432:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186198912 00000100:00100000:2.0:1787582703.613453:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787582703.613458:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186198912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582703.613466:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582703.613477:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4e9ce00/0xa113d808b7537cc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537cbb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.613508:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4e9ce00/0xa113d808b7537cc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537cbb expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.613518:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4e9ce00/0xa113d808b7537cc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537cbb expref: 19 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.613526:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9ce00, rc 0) 00000100:00100000:2.0:1787582703.613555:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186198912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582703.613561:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787582703.613591:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186198912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582703.613603:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537cbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537cc2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582703.613611:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537cbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537cc2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582703.613649:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186199040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.613672:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582703.613685:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5830c8300 going to sleep for 11 seconds 00000100:00100000:2.0:1787582703.613696:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186199040 00000100:00100000:2.0:1787582703.613699:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186199040 00000100:00100000:2.0:1787582703.613718:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787582703.613724:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186199040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.613907:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186199040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582703.613922:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787582703.613969:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186199040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.613994:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186199168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.614032:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582703.614045:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5830c8300 going to sleep for 11 seconds 00000100:00100000:2.0:1787582703.614056:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186199168 00000100:00100000:2.0:1787582703.614059:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186199168 00000100:00100000:2.0:1787582703.614081:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787582703.614087:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186199168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582703.614192:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186199168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582703.614199:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787582703.614235:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186199168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582703.626391:0:8577:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8577:1874416186199296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582703.626463:0:8577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582703.626503:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186199296 00000100:00100000:1.0:1787582703.626508:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186199296 00000100:00100000:1.0:1787582703.626553:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787582703.626566:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:8577:x1874416186199296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582703.626750:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:8577:x1874416186199296:12345-0@lo:502:llog_process_th.0 Request processed in 186us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582703.626758:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787582703.626804:0:8577:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5884bff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787582703.626823:0:8577:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8577:1874416186199296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787582703.629838:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582703.629856:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582703.629859:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787582703.633187:0:8577:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8da584c3b800 00000020:00000080:1.0:1787582703.633195:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787582703.633306:0:8577:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8577:1874416186199424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582703.633396:0:8577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582703.633431:0:8577:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5884bff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787582703.633816:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186199424 00000100:00100000:3.0:1787582703.633825:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186199424 00000100:00100000:3.0:1787582703.633888:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787582703.633897:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:8577:x1874416186199424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582703.634105:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:8577:x1874416186199424:12345-0@lo:502:llog_process_th.0 Request processed in 209us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582703.634112:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787582703.634242:0:8577:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:8577:1874416186199424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787582703.634266:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582703.634271:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582703.634273:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787582703.634276:0:8577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787582703.634407:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787582703.634422:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787582703.634430:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537cbb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537cc2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582703.634442:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537cbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537cc2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582704.085547:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582704.346761:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582704.346801:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162051968 00000100:00100000:0.0:1787582704.346809:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162051968 00000100:00100000:0.0:1787582704.346852:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 186 00000100:00100000:0.0:1787582704.346861:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:5599:x1874416162051968:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787582704.346878:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582704.346895:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da580031400/0xa113d808b7537cc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57ef9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582704.346921:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da580031400/0xa113d808b7537cc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ef9 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582704.346932:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da580031400/0xa113d808b7537cc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ef9 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582704.346951:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580031400, rc 0) 00000100:00100000:0.0:1787582704.346999:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5599:x1874416162051968:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 Request processed in 138us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582704.347013:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 186 00000100:00100000:2.0:1787582704.356226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582704.356435:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162052096 00000100:00100000:3.0:1787582704.356446:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162052096 00000100:00100000:3.0:1787582704.356503:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 187 00000100:00100000:3.0:1787582704.356512:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5599:x1874416162052096:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582704.356772:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5599:x1874416162052096:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 Request processed in 259us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582704.356780:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 187 00000100:00100000:3.0:1787582704.364256:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582704.364289:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162052224 00000100:00100000:3.0:1787582704.364299:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162052224 00000100:00100000:3.0:1787582704.364365:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 188 00000100:00100000:3.0:1787582704.364375:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5599:x1874416162052224:12345-192.168.206.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582704.364576:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:5599:x1874416162052224:12345-192.168.206.20@tcp:503:ll_cfg_requeue.0 Request processed in 202us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582704.364584:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 188 00000100:00100000:0.0:1787582704.395417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582704.395598:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162052352 00000100:00100000:2.0:1787582704.395608:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162052352 00000100:00100000:2.0:1787582704.395654:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 189 00000100:00100000:2.0:1787582704.395664:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:6138:x1874416162052352:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787582704.395878:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:6138:x1874416162052352:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 214us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582704.395887:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 189 00000100:00100000:3.0:1787582704.403151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582704.403247:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162052480 00000100:00100000:0.0:1787582704.403258:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162052480 00000100:00100000:0.0:1787582704.403340:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 190 00000100:00100000:0.0:1787582704.403351:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:6138:x1874416162052480:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787582704.403583:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:6138:x1874416162052480:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 233us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582704.403593:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 190 00010000:00010000:0.0:1787582705.105514:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582705.110663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582705.110947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582705.110985:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582705.111023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582705.111053:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162052992 00000100:00100000:3.0:1787582705.111062:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162052992 00000100:00100000:2.0:1787582705.111215:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162052608 00000100:00100000:2.0:1787582705.111219:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162052608 00000100:00100000:0.0:1787582705.111219:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162052736 00000100:00100000:0.0:1787582705.111222:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162052736 00000100:00100000:2.0:1787582705.111250:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 191 00000100:00100000:0.0:1787582705.111250:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 30 00000100:00100000:0.0:1787582705.111259:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162052736:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582705.111268:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2359:x1874416162052608:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582705.111353:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2359:x1874416162052608:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 84us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582705.111361:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 191 00000100:00100000:3.0:1787582705.111486:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162052864 00000100:00100000:3.0:1787582705.111490:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162052864 00000100:00100000:3.0:1787582705.111518:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:3.0:1787582705.111526:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162052992:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582705.111594:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 17 00000100:00100000:1.0:1787582705.111603:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162052864:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582705.117518:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162052736:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 6248us (6850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582705.117534:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 30 00000100:00080000:0.0:1787582705.117580:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787582705.117586:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787582705.117589:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787582705.119193:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162052992:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 7659us (8237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582705.119205:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:1.0:1787582705.120844:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162052864:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 9233us (9811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582705.120856:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 17 00010000:00010000:0.0:1787582706.142920:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582706.773509:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186199552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582706.773578:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582706.776423:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186199552 00000100:00100000:1.0:1787582706.776435:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186199552 00000100:00100000:1.0:1787582706.776516:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787582706.776527:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186199552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787582706.776563:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582706.776635:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186199552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (3056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582706.776642:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787582706.776682:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb6e4000 x1874416186199552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582722 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582706.776702:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186199552:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787582706.776952:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787582707.155885:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582707.793193:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186200064:0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.793256:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582707.793312:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787582707.793340:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186199680:0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.793382:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582707.793422:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186200192:0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.793445:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582707.793472:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186199808:0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.793501:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582707.793517:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186200320:0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.793539:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582707.793556:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582707.793562:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186199936:0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.793582:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582707.793609:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186200064 00000100:00100000:0.0:1787582707.793615:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186200064 00000100:00100000:0.0:1787582707.793659:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186200192 00000100:00100000:0.0:1787582707.793663:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186200192 00000100:00100000:0.0:1787582707.793676:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186199808 00000100:00100000:0.0:1787582707.793678:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186199808 00000100:00100000:0.0:1787582707.793691:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787582707.793704:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186200064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.793749:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186200064:12345-0@lo:400:kworker.0 Request processed in 50us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582707.793755:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787582707.793771:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787582707.793778:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186200192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.793804:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186200192:12345-0@lo:400:kworker.0 Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582707.793810:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787582707.793828:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787582707.793834:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186199808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.793865:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186199808:12345-0@lo:400:kworker.0 Request processed in 31us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582707.793871:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787582707.793893:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186200320 00000100:00100000:0.0:1787582707.793897:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186200320 00000100:00100000:0.0:1787582707.794050:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186199936 00000100:00100000:0.0:1787582707.794054:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186199936 00000100:00100000:0.0:1787582707.794078:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787582707.794084:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186200320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.794116:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186200320:12345-0@lo:400:kworker.0 Request processed in 32us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582707.794122:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787582707.794133:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787582707.794138:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186199936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.794164:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186199936:12345-0@lo:400:kworker.0 Request processed in 26us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582707.794169:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787582707.794187:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787582707.794191:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787582707.794289:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb683b80 x1874416186199936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582707.794303:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186199936:0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.794315:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186199808:0@lo:400:kworker.0 00010000:00080000:0.0:1787582707.794346:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb681f80 x1874416186200320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582707.794361:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186200320:0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.794461:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186200192:0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.794471:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186200064:0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.794506:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186199680 00000100:00100000:0.0:1787582707.794509:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186199680 00000100:00100000:0.0:1787582707.794540:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787582707.794547:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186199680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582707.794582:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186199680:12345-0@lo:400:kworker.0 Request processed in 35us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582707.794588:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787582707.794617:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186199680:0@lo:400:kworker.0 00010000:00010000:1.0:1787582708.178346:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582708.310670:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787582708.313674:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186200448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787582708.313747:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582708.313873:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186200448 00000100:00100000:1.0:1787582708.313882:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186200448 00000100:00100000:1.0:1787582708.313950:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787582708.313959:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186200448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787582708.313990:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582708.314032:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186200448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582708.314048:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787582708.314159:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb6e4000 x1874416186200448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582708.314177:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186200448:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787582708.464732:0:8819:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg620-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787582709.204499:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582710.226771:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582710.234257:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582710.234311:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582710.234388:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582710.234412:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582710.234491:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162053376 00000100:00100000:3.0:1787582710.234503:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162053376 00000100:00100000:3.0:1787582710.234580:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162053504 00000100:00100000:3.0:1787582710.234583:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162053504 00000100:00100000:3.0:1787582710.234608:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:3.0:1787582710.234618:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2357:x1874416162053376:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582710.234731:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2357:x1874416162053376:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 114us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582710.234740:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:3.0:1787582710.234758:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 21 00000100:00100000:3.0:1787582710.234764:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162053504:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582710.234785:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162053504:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 22us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582710.234791:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 21 00000100:00080000:2.0:1787582710.235030:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787582710.235035:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787582710.235282:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162053120 00000100:00100000:1.0:1787582710.235288:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162053120 00000100:00100000:1.0:1787582710.235360:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 193 00000100:00100000:1.0:1787582710.235368:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2357:x1874416162053120:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582710.235408:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2357:x1874416162053120:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 40us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582710.235414:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 193 00000100:00100000:0.0:1787582710.235984:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162053248 00000100:00100000:0.0:1787582710.235992:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162053248 00000100:00100000:0.0:1787582710.236053:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 34 00000100:00100000:0.0:1787582710.236061:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162053248:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582710.236113:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162053248:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 53us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582710.236120:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 34 00000100:00080000:2.0:1787582710.236246:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787582711.248986:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582711.899308:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186200576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787582711.899389:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582711.899458:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186200576 00000100:00100000:2.0:1787582711.899465:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186200576 00000100:00100000:2.0:1787582711.899511:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787582711.899520:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186200576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582711.899551:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582711.899591:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186200576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582711.899598:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787582711.899614:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787582711.901192:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb6e7480 x1874416186200576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582727 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582711.901222:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186200576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787582712.276210:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582712.912657:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186200832:0@lo:400:kworker.0 00000100:00100000:0.0:1787582712.912719:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582712.912771:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186201344:0@lo:400:kworker.0 00000100:00100000:0.0:1787582712.912814:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582712.912854:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582712.912860:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186200960:0@lo:400:kworker.0 00000100:00100000:0.0:1787582712.912907:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582712.912943:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186200832 00000100:00100000:0.0:1787582712.912951:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186200832 00000100:00100000:0.0:1787582712.913004:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787582712.913012:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186200832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582712.913174:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186201088:0@lo:400:kworker.0 00000100:00100000:3.0:1787582712.913203:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582712.913223:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787582712.913229:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186200704:0@lo:400:kworker.0 00000100:00100000:3.0:1787582712.913253:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582712.913271:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186201216:0@lo:400:kworker.0 00000100:00100000:3.0:1787582712.913290:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582712.913312:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186201088 00000100:00100000:3.0:1787582712.913333:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186201088 00000100:00100000:3.0:1787582712.913357:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186201216 00000100:00100000:3.0:1787582712.913360:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186201216 00000100:00100000:3.0:1787582712.913375:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787582712.913381:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186201088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582712.913418:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186201088:12345-0@lo:400:kworker.0 Request processed in 37us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582712.913425:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787582712.913446:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787582712.913452:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186201216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582712.913478:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186201216:12345-0@lo:400:kworker.0 Request processed in 26us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582712.913484:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787582712.913512:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186201216:0@lo:400:kworker.0 00000100:00100000:3.0:1787582712.913522:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186201088:0@lo:400:kworker.0 00000100:00100000:0.0:1787582712.913615:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186200832:12345-0@lo:400:kworker.0 Request processed in 603us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582712.913622:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787582712.913640:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186201344 00000100:00100000:0.0:1787582712.913643:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186201344 00000100:00100000:0.0:1787582712.913665:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186200960 00000100:00100000:0.0:1787582712.913668:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186200960 00000100:00100000:0.0:1787582712.913683:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787582712.913689:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186201344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582712.913716:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186201344:12345-0@lo:400:kworker.0 Request processed in 27us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582712.913722:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787582712.913732:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787582712.913737:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186200960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582712.913760:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483512a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186200960:12345-0@lo:400:kworker.0 Request processed in 23us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582712.913766:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787582712.913855:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb683800 x1874416186200960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582712.913865:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186200960:0@lo:400:kworker.0 00000100:00100000:3.0:1787582712.913875:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186200832:0@lo:400:kworker.0 00010000:00080000:3.0:1787582712.913883:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb683b80 x1874416186201344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582712.913905:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186201344:0@lo:400:kworker.0 00000100:00100000:2.0:1787582712.914347:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186200704 00000100:00100000:2.0:1787582712.914360:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186200704 00000100:00100000:2.0:1787582712.914397:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787582712.914405:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186200704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582712.914452:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186200704:12345-0@lo:400:kworker.0 Request processed in 48us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582712.914458:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:2.0:1787582712.914482:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787582712.914486:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582712.914555:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186200704:0@lo:400:kworker.0 00010000:00010000:3.0:1787582713.298567:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582713.428596:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582713.428616:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186201472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787582713.428684:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582713.428745:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186201472 00000100:00100000:0.0:1787582713.428752:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186201472 00000100:00100000:0.0:1787582713.428793:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787582713.428801:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186201472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787582713.428832:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582713.430004:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186201472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1191us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582713.430014:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1787582713.430347:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da483512d80 x1874416186201472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582713.430367:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483512d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186201472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787582714.322660:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787582715.060754:0:9062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg620-server.virtnet: executing yml_node 00010000:00010000:3.0:1787582715.346426:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582715.358505:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582715.358550:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582715.360915:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162053632 00000100:00100000:3.0:1787582715.360930:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162053632 00000100:00100000:3.0:1787582715.361380:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 195 00000100:00100000:3.0:1787582715.361393:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2360:x1874416162053632:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582715.361514:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162053760 00000100:00100000:0.0:1787582715.361519:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162053760 00000100:00100000:0.0:1787582715.361562:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 38 00000100:00100000:0.0:1787582715.361570:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2360:x1874416162053760:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582715.366978:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2360:x1874416162053632:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 5577us (8469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582715.367006:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 195 00000100:00100000:0.0:1787582715.368694:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2360:x1874416162053760:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 7114us (10132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582715.368707:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 38 00000100:00080000:3.0:1787582715.374556:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787582715.375658:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582715.375743:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582715.376266:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162053888 00000100:00100000:3.0:1787582715.376275:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162053888 00000100:00100000:3.0:1787582715.376406:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162054016 00000100:00100000:3.0:1787582715.376410:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162054016 00000100:00100000:0.0:1787582715.376463:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00100000:0.0:1787582715.376475:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2356:x1874416162053888:12345-192.168.206.20@tcp:9:kworker.0 00000020:00000080:0.0:1787582715.376520:0:6704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537c05 00000100:00080000:0.0:1787582715.376530:0:6704:0:(import.c:65:import_set_state_nolock()) ffff8da5855d2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787582715.376569:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787582715.376902:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+2:2356:x1874416162053888:12345-192.168.206.20@tcp:9:kworker.0 Request processed in 430us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582715.376923:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00080000:2.0:1787582715.377195:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787582715.377199:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787582715.377271:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582715.377743:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:3.0:1787582715.377754:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2356:x1874416162054016:12345-192.168.206.20@tcp:9:kworker.0 00000020:00000080:3.0:1787582715.377776:0:6705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537c0c 00000100:00080000:3.0:1787582715.377783:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8da5b6088000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787582715.378051:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787582715.378291:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+2:2356:x1874416162054016:12345-192.168.206.20@tcp:9:kworker.0 Request processed in 538us (2546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582715.378298:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 12 00010000:00010000:3.0:1787582715.378371:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582716.376339:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582717.008641:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787582717.008663:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186201600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787582717.008728:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582717.009166:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186201600 00000100:00100000:2.0:1787582717.009174:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186201600 00000100:00100000:2.0:1787582717.009245:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787582717.009255:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186201600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582717.009287:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582717.009363:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483512d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186201600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582717.009370:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787582717.009449:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bf925180 x1874416186201600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582717.009468:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186201600:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787582717.009565:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787582717.392529:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582718.039629:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186201856:0@lo:400:kworker.0 00000100:00100000:1.0:1787582718.039695:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582718.039746:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186202368:0@lo:400:kworker.0 00000100:00100000:1.0:1787582718.039771:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582718.039800:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582718.039806:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186201984:0@lo:400:kworker.0 00000100:00100000:1.0:1787582718.039828:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582718.039878:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186201856 00000100:00100000:1.0:1787582718.039885:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186201856 00000100:00100000:1.0:1787582718.039928:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787582718.039944:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186201856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582718.040193:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186202112:0@lo:400:kworker.0 00000100:00100000:3.0:1787582718.040223:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582718.040243:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787582718.040249:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186201728:0@lo:400:kworker.0 00000100:00100000:3.0:1787582718.040272:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582718.040294:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186202240:0@lo:400:kworker.0 00000100:00100000:3.0:1787582718.040313:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582718.040367:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186201728 00000100:00100000:3.0:1787582718.040371:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186201728 00000100:00100000:3.0:1787582718.040407:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787582718.040413:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186201728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582718.040447:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186201728:12345-0@lo:400:kworker.0 Request processed in 34us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582718.040454:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787582718.040602:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186201728:0@lo:400:kworker.0 00000100:00100000:3.0:1787582718.040641:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186202368 00000100:00100000:3.0:1787582718.040644:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186202368 00000100:00100000:3.0:1787582718.040673:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186201984 00000100:00100000:3.0:1787582718.040675:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186201984 00000100:00100000:3.0:1787582718.040692:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787582718.040698:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186202368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582718.040730:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186202368:12345-0@lo:400:kworker.0 Request processed in 32us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582718.040736:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787582718.040747:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787582718.040753:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186201984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582718.040777:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186201984:12345-0@lo:400:kworker.0 Request processed in 25us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582718.040782:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787582718.040802:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787582718.040818:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186202112 00000100:00100000:3.0:1787582718.040821:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186202112 00000100:00100000:1.0:1787582718.040941:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186201856:12345-0@lo:400:kworker.0 Request processed in 50us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582718.040948:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787582718.040960:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186202240 00000100:00100000:1.0:1787582718.040963:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186202240 00000100:00100000:1.0:1787582718.040980:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787582718.040985:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186202112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582718.041064:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787582718.041071:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186202240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582718.041105:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186202240:12345-0@lo:400:kworker.0 Request processed in 35us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582718.041119:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787582718.041134:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582718.041152:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186202240:0@lo:400:kworker.0 00010000:00080000:3.0:1787582718.041185:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da588495500 x1874416186201984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582718.041196:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186201984:0@lo:400:kworker.0 00000100:00100000:3.0:1787582718.041206:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186201856:0@lo:400:kworker.0 00010000:00080000:3.0:1787582718.041215:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da588495180 x1874416186202368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582718.041223:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186202368:0@lo:400:kworker.0 00000100:00100000:1.0:1787582718.041309:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186202112:12345-0@lo:400:kworker.0 Request processed in 323us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582718.041315:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787582718.042113:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186202112:0@lo:400:kworker.0 00010000:00010000:0.0:1787582718.417906:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582718.544611:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582718.544643:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186202496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582718.544730:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582718.544968:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186202496 00000100:00100000:2.0:1787582718.544978:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186202496 00000100:00100000:2.0:1787582718.545045:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787582718.545058:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186202496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787582718.545103:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582718.545183:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186202496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582718.545191:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1787582718.545354:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da483511880 x1874416186202496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582718.545376:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186202496:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787582718.609145:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 730f9f4f-46d8-441e-9162-5fde1074d6a5 00000020:00000080:3.0:1787582718.609157:0:7656:0:(genops.c:885:class_export_put()) final put ffff8da5a8c0f000/730f9f4f-46d8-441e-9162-5fde1074d6a5 00000020:00000080:0.0:1787582718.609217:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5a8c0f000/730f9f4f-46d8-441e-9162-5fde1074d6a5 for lustre-OST0001 00000020:00000080:0.0:1787582718.609278:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5b6088000 for lustre-OST0001 00000001:02000400:3.0:1787582718.725244:0:9254:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.80 00010000:00010000:1.0:1787582719.451107:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787582719.634957:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 730f9f4f-46d8-441e-9162-5fde1074d6a5 00000020:00000080:2.0:1787582719.634968:0:6733:0:(genops.c:885:class_export_put()) final put ffff8da58df19800/730f9f4f-46d8-441e-9162-5fde1074d6a5 00000020:00000080:0.0:1787582719.635518:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8da58df19800/730f9f4f-46d8-441e-9162-5fde1074d6a5 for lustre-OST0000 00000020:00000080:0.0:1787582719.635566:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5855d2800 for lustre-OST0000 00010000:00010000:0.0:1787582720.464617:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582720.469752:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582720.469824:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582720.469936:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162054144 00000100:00100000:2.0:1787582720.469944:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162054144 00000100:00100000:2.0:1787582720.469998:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 197 00000100:00100000:2.0:1787582720.470007:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589263c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2359:x1874416162054144:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582720.470075:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589263c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2359:x1874416162054144:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 69us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582720.470082:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 197 00000100:00100000:3.0:1787582720.471812:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162054272 00000100:00100000:3.0:1787582720.471836:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162054272 00000100:00100000:3.0:1787582720.472308:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 42 00000100:00100000:3.0:1787582720.472354:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162054272:12345-192.168.206.20@tcp:400:kworker.0 00000100:00080000:0.0:1787582720.472498:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582720.472590:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162054272:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 272us (2845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582720.472597:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 42 00000001:02000400:2.0:1787582720.925764:0:9353:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.80 00010000:00010000:1.0:1787582721.488560:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582722.129496:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582722.129519:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186202624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582722.129656:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582722.130782:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186202624 00000100:00100000:2.0:1787582722.130792:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186202624 00000100:00100000:2.0:1787582722.130934:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787582722.130944:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186202624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582722.130979:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582722.131040:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186202624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582722.131046:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787582722.131091:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bf927100 x1874416186202624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582722.131109:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186202624:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787582722.131161:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787582722.512757:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582723.153340:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186202752:0@lo:400:kworker.0 00000100:00100000:2.0:1787582723.153420:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582723.153486:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186203264:0@lo:400:kworker.0 00000100:00100000:2.0:1787582723.153513:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582723.153538:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787582723.153543:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186203136:0@lo:400:kworker.0 00000100:00100000:2.0:1787582723.153564:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582723.153594:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186203264 00000100:00100000:2.0:1787582723.153600:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186203264 00000100:00100000:2.0:1787582723.153645:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186203136 00000100:00100000:2.0:1787582723.153648:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186203136 00000100:00100000:2.0:1787582723.153670:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787582723.153678:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186203264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582723.153723:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186203264:12345-0@lo:400:kworker.0 Request processed in 45us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582723.153729:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787582723.153743:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787582723.153749:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186203136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582723.153772:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186203136:12345-0@lo:400:kworker.0 Request processed in 24us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582723.153777:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787582723.153825:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483513b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186203136:0@lo:400:kworker.0 00000100:00100000:2.0:1787582723.153850:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483512680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186203264:0@lo:400:kworker.0 00000100:00100000:1.0:1787582723.154170:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186202880:0@lo:400:kworker.0 00000100:00100000:1.0:1787582723.154202:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582723.154239:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186203392:0@lo:400:kworker.0 00000100:00100000:1.0:1787582723.154262:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582723.154279:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582723.154284:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186203008:0@lo:400:kworker.0 00000100:00100000:1.0:1787582723.154302:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582723.154344:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186202880 00000100:00100000:1.0:1787582723.154349:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186202880 00000100:00100000:1.0:1787582723.154376:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787582723.154383:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186202880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582723.154440:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186202880:12345-0@lo:400:kworker.0 Request processed in 57us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582723.154446:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787582723.154475:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483512300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186202880:0@lo:400:kworker.0 00000100:00100000:3.0:1787582723.154868:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186203392 00000100:00100000:3.0:1787582723.154881:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186203392 00000100:00100000:3.0:1787582723.154919:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186203008 00000100:00100000:3.0:1787582723.154923:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186203008 00000100:00100000:3.0:1787582723.154946:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787582723.154953:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186203392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582723.154993:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186203392:12345-0@lo:400:kworker.0 Request processed in 41us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582723.154999:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787582723.155010:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787582723.155016:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186203008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582723.155041:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186203008:12345-0@lo:400:kworker.0 Request processed in 26us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582723.155047:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787582723.155075:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787582723.155079:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787582723.155097:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da483513480 x1874416186203008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582723.155119:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483513480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186203008:0@lo:400:kworker.0 00010000:00080000:3.0:1787582723.155134:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da483513800 x1874416186203392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582723.155142:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186203392:0@lo:400:kworker.0 00000100:00100000:0.0:1787582723.155631:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186202752 00000100:00100000:0.0:1787582723.155637:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186202752 00000100:00100000:0.0:1787582723.155672:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787582723.155679:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186202752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582723.155727:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186202752:12345-0@lo:400:kworker.0 Request processed in 49us (2307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582723.155732:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787582723.157560:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483510000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186202752:0@lo:400:kworker.0 00010000:00010000:1.0:1787582723.538090:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582723.664511:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787582723.664547:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186203520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582723.664618:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582723.664782:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186203520 00000100:00100000:1.0:1787582723.664789:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186203520 00000100:00100000:1.0:1787582723.664856:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787582723.664867:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186203520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787582723.664899:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582723.664944:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186203520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582723.664951:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787582723.665247:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da588497800 x1874416186203520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582723.665285:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186203520:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787582724.129771:0:9452:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.80 00010000:00010000:0.0:1787582724.562735:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582725.586066:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582725.588913:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582725.588961:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582725.589041:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162054528 00000100:00100000:2.0:1787582725.589050:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162054528 00000100:00100000:3.0:1787582725.589080:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162054400 00000100:00100000:3.0:1787582725.589084:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162054400 00000100:00100000:3.0:1787582725.589121:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 199 00000100:00100000:2.0:1787582725.589121:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 46 00000100:00100000:3.0:1787582725.589131:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2357:x1874416162054400:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582725.589131:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2357:x1874416162054528:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582725.589201:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2357:x1874416162054400:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 71us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582725.589209:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 199 00000100:00080000:0.0:1787582725.589211:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787582725.599016:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2357:x1874416162054528:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 9875us (10042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582725.599031:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 46 00010000:00010000:0.0:1787582726.608540:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787582726.855768:0:9501:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Aug 24 10:45:25 EDT 2026 00000100:00100000:0.0:1787582727.251052:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787582727.251072:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186203648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787582727.251132:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582727.251284:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186203648 00000100:00100000:1.0:1787582727.251291:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186203648 00000100:00100000:1.0:1787582727.251374:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787582727.251382:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186203648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787582727.251410:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582727.251450:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483511f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186203648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582727.251457:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1787582727.251489:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bf926a00 x1874416186203648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582727.251504:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf926a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186203648:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787582727.251637:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787582727.640444:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582728.274987:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186204032:0@lo:400:kworker.0 00000100:00100000:3.0:1787582728.275054:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582728.275105:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787582728.275111:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186203904:0@lo:400:kworker.0 00000100:00100000:3.0:1787582728.275149:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582728.275167:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186204416:0@lo:400:kworker.0 00000100:00100000:3.0:1787582728.275185:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582728.275214:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186204032 00000100:00100000:3.0:1787582728.275220:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186204032 00000100:00100000:3.0:1787582728.275254:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186204416 00000100:00100000:3.0:1787582728.275256:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186204416 00000100:00100000:3.0:1787582728.275279:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787582728.275286:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186204032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582728.275345:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb683480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186204032:12345-0@lo:400:kworker.0 Request processed in 59us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582728.275352:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787582728.275365:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787582728.275370:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186204416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582728.275392:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186204416:12345-0@lo:400:kworker.0 Request processed in 22us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582728.275397:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787582728.275411:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186203904 00000100:00100000:3.0:1787582728.275413:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186203904 00000100:00100000:3.0:1787582728.275440:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787582728.275445:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf87b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186203904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582728.275470:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf87b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186203904:12345-0@lo:400:kworker.0 Request processed in 25us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582728.275475:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787582728.275512:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186203904:0@lo:400:kworker.0 00010000:00080000:3.0:1787582728.275522:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb681f80 x1874416186204416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582728.275533:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186204416:0@lo:400:kworker.0 00010000:00080000:3.0:1787582728.275541:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb683b80 x1874416186204032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582728.275548:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186204032:0@lo:400:kworker.0 00000100:00100000:0.0:1787582728.275717:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186204160:0@lo:400:kworker.0 00000100:00100000:0.0:1787582728.275743:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582728.275768:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787582728.275773:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186203776:0@lo:400:kworker.0 00000100:00100000:0.0:1787582728.275814:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582728.275835:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186204288:0@lo:400:kworker.0 00000100:00100000:0.0:1787582728.275852:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787582728.275870:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787582728.275879:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186203776 00000100:00100000:0.0:1787582728.275882:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186203776 00000100:00100000:0.0:1787582728.275905:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787582728.275911:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589263050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186203776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582728.275941:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589263050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186203776:12345-0@lo:400:kworker.0 Request processed in 30us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582728.275947:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787582728.275967:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186204160 00000100:00100000:0.0:1787582728.275970:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186204160 00000100:00100000:0.0:1787582728.275989:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186204288 00000100:00100000:0.0:1787582728.275991:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186204288 00000100:00100000:0.0:1787582728.276005:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787582728.276010:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186204160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582728.276033:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483510700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186204160:12345-0@lo:400:kworker.0 Request processed in 23us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582728.276038:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787582728.276059:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787582728.276064:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186204288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582728.276096:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483510e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186204288:12345-0@lo:400:kworker.0 Request processed in 32us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582728.276101:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1787582728.276117:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582728.276130:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186203776:0@lo:400:kworker.0 00000100:00100000:0.0:1787582728.276139:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb683800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186204288:0@lo:400:kworker.0 00000100:00100000:0.0:1787582728.276146:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186204160:0@lo:400:kworker.0 00010000:00010000:2.0:1787582728.656407:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582728.784792:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582728.784820:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186204544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582728.784878:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582728.784936:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186204544 00000100:00100000:1.0:1787582728.784943:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186204544 00000100:00100000:1.0:1787582728.784981:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787582728.784989:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186204544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787582728.785016:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582728.785052:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186204544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582728.785058:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787582728.785090:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da588494700 x1874416186204544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582728.785106:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588494700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186204544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787582729.691390:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582730.706579:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582730.711027:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582730.711064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582730.711235:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162054656 00000100:00100000:0.0:1787582730.711244:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162054784 00000100:00100000:3.0:1787582730.711245:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162054656 00000100:00100000:0.0:1787582730.711252:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162054784 00000100:00100000:0.0:1787582730.711309:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 50 00000100:00100000:0.0:1787582730.711335:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2357:x1874416162054784:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582730.711384:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 201 00000100:00100000:3.0:1787582730.711393:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2357:x1874416162054656:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582730.711406:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2357:x1874416162054784:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 89us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582730.711414:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 50 00000100:00100000:3.0:1787582730.711428:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2357:x1874416162054656:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 35us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582730.711436:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 201 00000100:00080000:2.0:1787582730.714176:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787582731.728680:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582732.368685:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582732.368708:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186204672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582732.368772:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582732.369052:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186204672 00000100:00100000:2.0:1787582732.369060:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186204672 00000100:00100000:2.0:1787582732.369120:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787582732.369130:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186204672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582732.369161:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787582732.369560:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787582732.370606:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186204672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1474us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582732.370618:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787582732.376729:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bf925180 x1874416186204672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582732.376757:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186204672:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787582732.752525:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582733.392868:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186204928:0@lo:400:kworker.0 00000100:00100000:1.0:1787582733.392975:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582733.393046:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186205440:0@lo:400:kworker.0 00000100:00100000:1.0:1787582733.393077:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582733.393113:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582733.393120:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186205056:0@lo:400:kworker.0 00000100:00100000:1.0:1787582733.393143:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582733.393391:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186205184:0@lo:400:kworker.0 00000100:00100000:0.0:1787582733.393426:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582733.393448:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787582733.393454:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186204800:0@lo:400:kworker.0 00000100:00100000:0.0:1787582733.393486:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582733.393513:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186205312:0@lo:400:kworker.0 00000100:00100000:0.0:1787582733.393539:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582733.393582:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186204928 00000100:00100000:0.0:1787582733.393591:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186204928 00000100:00100000:0.0:1787582733.393651:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186205184 00000100:00100000:0.0:1787582733.393655:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186205184 00000100:00100000:0.0:1787582733.393684:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186205312 00000100:00100000:0.0:1787582733.393688:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186205312 00000100:00100000:0.0:1787582733.393711:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787582733.393721:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186204928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582733.393796:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186204928:12345-0@lo:400:kworker.0 Request processed in 76us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582733.393804:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787582733.393832:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787582733.393838:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186205184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582733.393868:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483511c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186205184:12345-0@lo:400:kworker.0 Request processed in 31us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582733.393874:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787582733.393885:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787582733.393891:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186205312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582733.393916:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186205312:12345-0@lo:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582733.393922:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787582733.393940:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186204800 00000100:00100000:0.0:1787582733.393943:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186204800 00000100:00100000:0.0:1787582733.393970:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787582733.393977:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186204800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582733.394006:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186204800:12345-0@lo:400:kworker.0 Request processed in 31us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582733.394013:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1787582733.394046:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582733.394086:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186204800:0@lo:400:kworker.0 00000100:00100000:0.0:1787582733.394100:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186205312:0@lo:400:kworker.0 00000100:00100000:0.0:1787582733.394110:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186205184:0@lo:400:kworker.0 00000100:00100000:0.0:1787582733.394146:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186204928:0@lo:400:kworker.0 00000100:00100000:3.0:1787582733.394239:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186205440 00000100:00100000:3.0:1787582733.394250:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186205440 00000100:00100000:3.0:1787582733.394299:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186205056 00000100:00100000:3.0:1787582733.394303:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186205056 00000100:00100000:3.0:1787582733.394353:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787582733.394363:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186205440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582733.394411:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186205440:12345-0@lo:400:kworker.0 Request processed in 50us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582733.394419:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787582733.394434:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787582733.394442:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186205056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582733.394477:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186205056:12345-0@lo:400:kworker.0 Request processed in 37us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582733.394484:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787582733.394534:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da588495c00 x1874416186205056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582733.394548:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186205056:0@lo:400:kworker.0 00010000:00080000:3.0:1787582733.394562:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da588494e00 x1874416186205440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582733.394572:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186205440:0@lo:400:kworker.0 00000100:00080000:0.0:1787582733.395124:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787582733.789635:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582733.906409:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186205568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582733.906509:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582733.906607:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186205568 00000100:00100000:2.0:1787582733.906616:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186205568 00000100:00100000:2.0:1787582733.906688:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787582733.906698:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186205568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787582733.906743:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582733.917601:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186205568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10890us (11079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582733.917620:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787582733.918116:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bf925180 x1874416186205568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582733.918147:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186205568:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787582734.801244:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582735.829289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582735.829350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582735.829423:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162054912 00000100:00100000:2.0:1787582735.829432:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162054912 00000100:00100000:2.0:1787582735.829484:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 203 00000100:00100000:2.0:1787582735.829494:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2358:x1874416162054912:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582735.829565:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2358:x1874416162054912:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 72us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582735.829573:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 203 00010000:00010000:1.0:1787582735.830350:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582735.833830:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162055040 00000100:00100000:0.0:1787582735.833845:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162055040 00000100:00100000:0.0:1787582735.833912:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 54 00000100:00100000:0.0:1787582735.833923:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162055040:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582735.833994:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162055040:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 72us (4714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582735.834002:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 54 00000100:00080000:0.0:1787582735.834031:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787582736.848522:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582737.489993:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582737.490026:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186205696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582737.490116:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582737.490230:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186205696 00000100:00100000:2.0:1787582737.490240:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186205696 00000100:00100000:2.0:1787582737.490370:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787582737.490383:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186205696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582737.490428:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582737.490485:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186205696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582737.490493:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787582737.490747:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787582737.490842:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5b4fa0000 x1874416186205696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582737.490887:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186205696:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787582737.875258:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582738.512873:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787582738.513026:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186206080:0@lo:400:kworker.0 00000100:00100000:1.0:1787582738.513113:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582738.513178:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787582738.513185:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186205952:0@lo:400:kworker.0 00000100:00100000:1.0:1787582738.513213:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582738.513246:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186205952 00000100:00100000:1.0:1787582738.513254:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186205952 00000100:00100000:1.0:1787582738.513367:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787582738.513378:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186205952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582738.513450:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186205952:12345-0@lo:400:kworker.0 Request processed in 74us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582738.513458:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787582738.513660:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186205952:0@lo:400:kworker.0 00000100:00100000:3.0:1787582738.514110:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186206208:0@lo:400:kworker.0 00000100:00100000:3.0:1787582738.514149:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582738.514192:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186205824:0@lo:400:kworker.0 00000100:00100000:3.0:1787582738.514221:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582738.514261:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186206080 00000100:00100000:3.0:1787582738.514266:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186206080 00000100:00100000:3.0:1787582738.514313:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787582738.514339:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186206080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582738.514586:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186206208 00000100:00100000:1.0:1787582738.514593:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186206208 00000100:00100000:1.0:1787582738.514633:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787582738.514640:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186206208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582738.514686:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186206208:12345-0@lo:400:kworker.0 Request processed in 46us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582738.514692:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787582738.514711:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582738.514871:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186206080:12345-0@lo:400:kworker.0 Request processed in 534us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582738.514878:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787582738.514902:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186205824 00000100:00100000:3.0:1787582738.514907:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186205824 00000100:00100000:3.0:1787582738.514941:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787582738.514948:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186205824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582738.514979:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186205824:12345-0@lo:400:kworker.0 Request processed in 32us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582738.514985:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787582738.515034:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186206208:0@lo:400:kworker.0 00000100:00100000:3.0:1787582738.515044:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186205824:0@lo:400:kworker.0 00010000:00080000:1.0:1787582738.515116:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5b4fa1c00 x1874416186206080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582738.515129:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186206080:0@lo:400:kworker.0 00000100:00100000:1.0:1787582738.515720:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186206336:0@lo:400:kworker.0 00000100:00100000:1.0:1787582738.515764:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582738.515847:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186206464:0@lo:400:kworker.0 00000100:00100000:2.0:1787582738.515877:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582738.515910:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186206464 00000100:00100000:2.0:1787582738.515914:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186206464 00000100:00100000:2.0:1787582738.515954:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787582738.515961:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186206464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582738.515999:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186206464:12345-0@lo:400:kworker.0 Request processed in 40us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582738.516005:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787582738.516023:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787582738.516044:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5855c3480 x1874416186206464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582738.516054:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186206464:0@lo:400:kworker.0 00000100:00100000:0.0:1787582738.516112:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186206336 00000100:00100000:0.0:1787582738.516117:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186206336 00000100:00100000:0.0:1787582738.516157:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787582738.516164:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186206336:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787582738.516219:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582738.523150:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186206336:12345-0@lo:400:kworker.0 Request processed in 6976us (7375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582738.523166:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787582738.527718:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186206336:0@lo:400:kworker.0 00010000:00010000:1.0:1787582738.912468:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582739.032154:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186206592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582739.032215:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582739.032385:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186206592 00000100:00100000:1.0:1787582739.032392:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186206592 00000100:00100000:1.0:1787582739.032432:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787582739.032441:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186206592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787582739.032479:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582739.032517:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186206592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582739.032524:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787582739.033439:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb685f80 x1874416186206592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582739.033458:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186206592:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787582739.923076:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582740.945682:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582740.947520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582740.947598:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162055168 00000100:00100000:2.0:1787582740.947607:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162055168 00000100:00100000:2.0:1787582740.947659:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 205 00000100:00100000:2.0:1787582740.947677:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2360:x1874416162055168:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582740.947768:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2360:x1874416162055168:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 101us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582740.947775:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 205 00000100:00100000:2.0:1787582740.948719:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582740.948841:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162055296 00000100:00100000:3.0:1787582740.948847:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162055296 00000100:00100000:3.0:1787582740.948909:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 58 00000100:00100000:3.0:1787582740.948917:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2360:x1874416162055296:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582740.948960:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2360:x1874416162055296:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 43us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582740.948974:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 58 00000100:00080000:2.0:1787582740.949245:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787582741.975180:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582742.608773:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186206720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582742.608837:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582742.608947:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186206720 00000100:00100000:2.0:1787582742.608954:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186206720 00000100:00100000:2.0:1787582742.609007:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787582742.609015:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186206720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582742.609047:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582742.609089:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186206720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582742.609096:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787582742.609142:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787582742.609166:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5855c3800 x1874416186206720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582742.609182:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186206720:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787582742.998832:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582743.633498:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186206848:0@lo:400:kworker.0 00000100:00100000:1.0:1787582743.633568:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582743.633784:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186206848 00000100:00100000:0.0:1787582743.633792:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186206848 00000100:00100000:0.0:1787582743.633837:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1787582743.633846:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186206848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582743.636492:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186207232:0@lo:400:kworker.0 00000100:00100000:3.0:1787582743.636560:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582743.636713:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186207232 00000100:00100000:3.0:1787582743.636720:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186207232 00000100:00100000:2.0:1787582743.641734:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186206976:0@lo:400:kworker.0 00000100:00100000:2.0:1787582743.641807:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582743.642625:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186206848:12345-0@lo:400:kworker.0 Request processed in 8768us (9045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582743.642637:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787582743.643552:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186206848:0@lo:400:kworker.0 00000100:00100000:1.0:1787582743.643584:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da586c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186207360:0@lo:400:kworker.0 00000100:00100000:2.0:1787582743.644607:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da586c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186207488:0@lo:400:kworker.0 00000100:00100000:2.0:1787582743.644642:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582743.644666:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787582743.644672:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186207104:0@lo:400:kworker.0 00000100:00100000:2.0:1787582743.644694:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582743.644743:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582743.647869:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186206976 00000100:00100000:3.0:1787582743.647881:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186206976 00000100:00100000:3.0:1787582743.647963:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787582743.647973:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186207232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582743.648048:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186207232:12345-0@lo:400:kworker.0 Request processed in 78us (11487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582743.648054:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787582743.648069:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787582743.648075:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186206976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582743.648106:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186206976:12345-0@lo:400:kworker.0 Request processed in 31us (6300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582743.648111:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1787582743.648131:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582743.648163:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186207232:0@lo:400:kworker.0 00000100:00100000:3.0:1787582743.648191:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186207488 00000100:00100000:3.0:1787582743.648194:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186207488 00000100:00100000:3.0:1787582743.648221:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186207104 00000100:00100000:3.0:1787582743.648224:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186207104 00000100:00100000:3.0:1787582743.648240:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787582743.648246:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186207488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582743.648274:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186207488:12345-0@lo:400:kworker.0 Request processed in 28us (3631us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582743.648292:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787582743.648302:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787582743.648308:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186207104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582743.648356:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186207104:12345-0@lo:400:kworker.0 Request processed in 48us (3661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582743.648362:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787582743.648395:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5855c2680 x1874416186207104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582743.648407:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186207104:0@lo:400:kworker.0 00000100:00100000:3.0:1787582743.648420:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186206976:0@lo:400:kworker.0 00010000:00080000:3.0:1787582743.648430:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da586c7dc00 x1874416186207488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582743.648439:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da586c7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186207488:0@lo:400:kworker.0 00000100:00080000:3.0:1787582743.648467:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787582743.657847:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186207360 00000100:00100000:0.0:1787582743.657860:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186207360 00000100:00100000:0.0:1787582743.657932:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787582743.657941:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186207360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582743.658021:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186207360:12345-0@lo:400:kworker.0 Request processed in 81us (13276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582743.658028:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1787582743.658404:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582743.658437:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da586c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186207360:0@lo:400:kworker.0 00010000:00010000:2.0:1787582744.016508:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582744.146294:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186207616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787582744.146371:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582744.146796:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186207616 00000100:00100000:1.0:1787582744.146803:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186207616 00000100:00100000:1.0:1787582744.146852:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787582744.146861:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186207616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787582744.146892:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582744.146951:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186207616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582744.146959:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787582744.147127:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb684e00 x1874416186207616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582744.147154:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186207616:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787582745.040867:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582746.065495:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582746.068837:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582746.068892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582746.068999:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162055424 00000100:00100000:1.0:1787582746.069011:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162055424 00000100:00100000:1.0:1787582746.069083:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 207 00000100:00100000:1.0:1787582746.069094:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2359:x1874416162055424:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582746.069187:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2359:x1874416162055424:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 94us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582746.069196:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 207 00000100:00100000:0.0:1787582746.069554:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162055552 00000100:00100000:0.0:1787582746.069560:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162055552 00000100:00100000:0.0:1787582746.069617:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 62 00000100:00100000:0.0:1787582746.069626:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162055552:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582746.069670:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162055552:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 45us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582746.069676:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 62 00000100:00080000:1.0:1787582746.069856:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787582746.630851:0:10133:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:45:45 (1787582745) === 00000100:00100000:2.0:1787582747.048612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582747.048749:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162055680 00000100:00100000:1.0:1787582747.048762:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162055680 00000100:00100000:1.0:1787582747.048837:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 208 00000100:00100000:1.0:1787582747.048850:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:8133:x1874416162055680:12345-192.168.206.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787582747.048871:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582747.048895:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5bb6b6800/0xa113d808b7537cd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57f00 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582747.048930:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5bb6b6800/0xa113d808b7537cd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f00 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582747.048942:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5bb6b6800/0xa113d808b7537cd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f00 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582747.048953:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6800, rc 0) 00000100:00100000:1.0:1787582747.049026:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:8133:x1874416162055680:12345-192.168.206.20@tcp:101:mount.lustre.0 Request processed in 178us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582747.049034:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 208 00000100:00100000:0.0:1787582747.076408:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582747.076715:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162055808 00000100:00100000:2.0:1787582747.076728:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162055808 00000100:00100000:2.0:1787582747.076797:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 209 00000100:00100000:2.0:1787582747.076809:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:8133:x1874416162055808:12345-192.168.206.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787582747.080770:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:8133:x1874416162055808:12345-192.168.206.20@tcp:501:mount.lustre.0 Request processed in 3954us (4367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582747.080783:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 209 00010000:00010000:0.0:1787582747.088815:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582747.092901:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582747.104062:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162055936 00000100:00100000:3.0:1787582747.104085:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162055936 00000100:00100000:3.0:1787582747.104179:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 210 00000100:00100000:3.0:1787582747.104192:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:8133:x1874416162055936:12345-192.168.206.20@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787582747.105004:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:8133:x1874416162055936:12345-192.168.206.20@tcp:503:mount.lustre.0 Request processed in 810us (12113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582747.105016:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 210 00000100:00100000:0.0:1787582747.112496:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582747.112818:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162056064 00000100:00100000:2.0:1787582747.112832:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162056064 00000100:00100000:2.0:1787582747.112901:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 211 00000100:00100000:2.0:1787582747.112913:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:8137:x1874416162056064:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787582747.113304:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:8137:x1874416162056064:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 391us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582747.113314:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 211 00000100:00100000:0.0:1787582747.137094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582747.137190:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162056192 00000100:00100000:3.0:1787582747.137202:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162056192 00000100:00100000:3.0:1787582747.137265:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 212 00000100:00100000:3.0:1787582747.137276:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:8137:x1874416162056192:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787582747.137664:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:8137:x1874416162056192:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 388us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582747.137673:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 212 00000100:00100000:3.0:1787582747.162833:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582747.163272:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162056320 00000100:00100000:2.0:1787582747.163285:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162056320 00000100:00100000:2.0:1787582747.163378:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 213 00000100:00100000:2.0:1787582747.163391:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:8133:x1874416162056320:12345-192.168.206.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787582747.163413:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582747.163437:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4e9ca00/0xa113d808b7537cd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57f2a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582747.163474:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4e9ca00/0xa113d808b7537cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f2a expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582747.163501:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4e9ca00/0xa113d808b7537cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f2a expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582747.163513:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9ca00, rc 0) 00000100:00100000:2.0:1787582747.163602:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:8133:x1874416162056320:12345-192.168.206.20@tcp:101:mount.lustre.0 Request processed in 212us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582747.163610:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 213 00000100:00100000:0.0:1787582747.167913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582747.168025:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162056448 00000100:00100000:1.0:1787582747.168039:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162056448 00000100:00100000:1.0:1787582747.168110:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 214 00000100:00100000:1.0:1787582747.168121:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:8133:x1874416162056448:12345-192.168.206.20@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787582747.168174:0:5847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787582747.168197:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787582747.168201:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787582747.168205:0:5847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787582747.168208:0:5847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787582747.170649:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:8133:x1874416162056448:12345-192.168.206.20@tcp:256:mount.lustre.0 Request processed in 2516us (2738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582747.171977:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 214 00000100:00100000:3.0:1787582747.175253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582747.175377:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162056576 00000100:00100000:1.0:1787582747.175389:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162056576 00000100:00100000:1.0:1787582747.175465:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 215 00000100:00100000:1.0:1787582747.175478:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:8133:x1874416162056576:12345-192.168.206.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787582747.175500:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582747.175533:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5bb6b7000/0xa113d808b7537cde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57f31 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582747.175568:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5bb6b7000/0xa113d808b7537cde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f31 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582747.175580:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5bb6b7000/0xa113d808b7537cde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f31 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582747.175590:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7000, rc 0) 00000100:00100000:1.0:1787582747.175673:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:8133:x1874416162056576:12345-192.168.206.20@tcp:101:mount.lustre.0 Request processed in 197us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582747.175681:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 215 00000100:00100000:0.0:1787582747.178422:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582747.179939:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162056704 00000100:00100000:1.0:1787582747.179971:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162056704 00000100:00100000:1.0:1787582747.180051:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 216 00000100:00100000:1.0:1787582747.180063:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:8133:x1874416162056704:12345-192.168.206.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787582747.180498:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:8133:x1874416162056704:12345-192.168.206.20@tcp:501:mount.lustre.0 Request processed in 435us (2086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582747.180507:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 216 00000100:00100000:0.0:1787582747.185007:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582747.185107:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162056832 00000100:00100000:2.0:1787582747.185120:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162056832 00000100:00100000:2.0:1787582747.185191:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 217 00000100:00100000:2.0:1787582747.185202:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:8133:x1874416162056832:12345-192.168.206.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787582747.185537:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:8133:x1874416162056832:12345-192.168.206.20@tcp:503:mount.lustre.0 Request processed in 336us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582747.185546:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 217 00000100:00100000:2.0:1787582747.189800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582747.190374:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162056960 00000100:00100000:3.0:1787582747.190388:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162056960 00000100:00100000:3.0:1787582747.190477:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 218 00000100:00100000:3.0:1787582747.190490:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:8142:x1874416162056960:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787582747.191103:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:8142:x1874416162056960:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 613us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582747.191112:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 218 00000100:00100000:0.0:1787582747.196031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582747.199984:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162057088 00000100:00100000:2.0:1787582747.200006:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162057088 00000100:00100000:2.0:1787582747.200185:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 219 00000100:00100000:2.0:1787582747.200199:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:8142:x1874416162057088:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787582747.200958:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:8142:x1874416162057088:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 757us (4933us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582747.200969:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 219 00000100:00100000:0.0:1787582747.215603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582747.215638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582747.215689:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162057216 00000100:00100000:3.0:1787582747.215699:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162057216 00000100:00100000:3.0:1787582747.215747:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162057600 00000100:00100000:3.0:1787582747.215750:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162057600 00000100:00100000:3.0:1787582747.215906:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 63 00000100:00100000:3.0:1787582747.215919:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2357:x1874416162057600:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582747.216008:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483510a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2357:x1874416162057600:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 92us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582747.216017:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 63 00000100:00100000:3.0:1787582747.216035:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00100000:3.0:1787582747.216039:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2356:x1874416162057216:12345-192.168.206.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787582747.216952:0:7653:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 83345526-3920-4b94-b598-4d9f74280322@192.168.206.20@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:2.0:1787582747.216987:0:7653:0:(genops.c:1385:class_connect()) connect: client 83345526-3920-4b94-b598-4d9f74280322, cookie 0xa113d808b7537ce5 00000004:00100000:2.0:1787582747.217020:0:7653:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787582747.217491:0:7653:0:(import.c:65:import_set_state_nolock()) ffff8da5bf45c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787582747.217668:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483510380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+6:2356:x1874416162057216:12345-192.168.206.20@tcp:38:mount.lustre.0 Request processed in 1625us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582747.217687:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00100000:0.0:1787582747.232293:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582747.232520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582747.236273:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162057344 00000100:00100000:1.0:1787582747.236294:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162057344 00000100:00100000:1.0:1787582747.236958:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162057472 00000100:00100000:1.0:1787582747.236964:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162057472 00000100:00100000:1.0:1787582747.236996:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00100000:1.0:1787582747.237007:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+7:0:x1874416162057344:12345-192.168.206.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787582747.237505:0:7653:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787582747.239137:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:2.0:1787582747.239169:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83345526-3920-4b94-b598-4d9f74280322+7:8133:x1874416162057472:12345-192.168.206.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787582747.239209:0:5855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787582747.240933:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483510000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83345526-3920-4b94-b598-4d9f74280322+7:8133:x1874416162057472:12345-192.168.206.20@tcp:41:mount.lustre.0 Request processed in 1772us (8403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582747.240946:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:1.0:1787582747.243247:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483511180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+6:0:x1874416162057344:12345-192.168.206.20@tcp:41:mount.lustre.0 Request processed in 6234us (10962us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582747.243259:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00080000:0.0:1787582747.243849:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582747.244073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582747.245052:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162057728 00000100:00100000:1.0:1787582747.245062:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162057728 00000100:00100000:1.0:1787582747.245151:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:1.0:1787582747.245160:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83345526-3920-4b94-b598-4d9f74280322+6:8133:x1874416162057728:12345-192.168.206.20@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787582747.245240:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf879500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83345526-3920-4b94-b598-4d9f74280322+6:8133:x1874416162057728:12345-192.168.206.20@tcp:40:mount.lustre.0 Request processed in 80us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582747.245247:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:3.0:1787582747.251294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582747.251387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582747.251412:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162057856 00000100:00100000:0.0:1787582747.251430:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162057856 00000100:00100000:0.0:1787582747.251499:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162057984 00000100:00100000:0.0:1787582747.251502:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162057984 00000100:00100000:0.0:1787582747.251745:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:0.0:1787582747.251756:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1874416162057856:12345-192.168.206.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787582747.251797:0:8218:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 83345526-3920-4b94-b598-4d9f74280322@192.168.206.20@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:0.0:1787582747.251872:0:8218:0:(genops.c:1385:class_connect()) connect: client 83345526-3920-4b94-b598-4d9f74280322, cookie 0xa113d808b7537cec 00002000:00100000:0.0:1787582747.251888:0:8218:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 83345526-3920-4b94-b598-4d9f74280322/ffff8da5855d3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787582747.251918:0:8218:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787582747.252685:0:8218:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787582747.255759:0:8218:0:(import.c:65:import_set_state_nolock()) ffff8da5855d0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787582747.255839:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf878380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83345526-3920-4b94-b598-4d9f74280322+6:2356:x1874416162057856:12345-192.168.206.20@tcp:8:mount.lustre.0 Request processed in 4080us (4549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582747.255998:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:0.0:1787582747.256034:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:0.0:1787582747.256041:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1874416162057984:12345-192.168.206.20@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787582747.256067:0:8218:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 83345526-3920-4b94-b598-4d9f74280322@192.168.206.20@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:0.0:1787582747.256095:0:8218:0:(genops.c:1385:class_connect()) connect: client 83345526-3920-4b94-b598-4d9f74280322, cookie 0xa113d808b7537cf3 00002000:00100000:0.0:1787582747.256119:0:8218:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 83345526-3920-4b94-b598-4d9f74280322/ffff8da5855d0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787582747.256143:0:8218:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787582747.257591:0:8218:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787582747.257656:0:8218:0:(import.c:65:import_set_state_nolock()) ffff8da5855d1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787582747.257716:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83345526-3920-4b94-b598-4d9f74280322+6:2356:x1874416162057984:12345-192.168.206.20@tcp:8:mount.lustre.0 Request processed in 1662us (6316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582747.257725:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:0.0:1787582747.257925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582747.258040:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162058112 00000100:00100000:3.0:1787582747.258122:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162058112 00000100:00100000:0.0:1787582747.258240:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 1 00000100:00100000:0.0:1787582747.258254:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83345526-3920-4b94-b598-4d9f74280322+6:8133:x1874416162058112:12345-192.168.206.20@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787582747.258471:0:5857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787582747.258614:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:83345526-3920-4b94-b598-4d9f74280322+6:8133:x1874416162058112:12345-192.168.206.20@tcp:33:mount.lustre.0 Request processed in 363us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582747.258622:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 1 00000100:00100000:0.0:1787582747.729196:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787582747.740008:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da586c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186207744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787582747.740091:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582747.742079:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186207744 00000100:00100000:1.0:1787582747.742093:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186207744 00000100:00100000:1.0:1787582747.742158:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787582747.742169:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186207744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787582747.742224:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582747.742290:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483513480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186207744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (2198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582747.742298:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787582747.748555:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787582747.748608:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da586c7ed80 x1874416186207744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582747.748632:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da586c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186207744:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787582748.116851:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582748.757653:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186207872:0@lo:400:kworker.0 00000100:00100000:0.0:1787582748.757732:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582748.757795:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186208384:0@lo:400:kworker.0 00000100:00100000:0.0:1787582748.757837:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582748.757859:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787582748.757866:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186208256:0@lo:400:kworker.0 00000100:00100000:0.0:1787582748.757888:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582748.757913:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186208000:0@lo:400:kworker.0 00000100:00100000:0.0:1787582748.757935:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582748.757951:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186208512:0@lo:400:kworker.0 00000100:00100000:0.0:1787582748.757974:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582748.757991:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582748.757997:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186208128:0@lo:400:kworker.0 00000100:00100000:0.0:1787582748.758018:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582748.758045:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186208384 00000100:00100000:0.0:1787582748.758053:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186208384 00000100:00100000:0.0:1787582748.758099:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186208256 00000100:00100000:0.0:1787582748.758102:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186208256 00000100:00100000:0.0:1787582748.758116:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186208000 00000100:00100000:0.0:1787582748.758118:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186208000 00000100:00100000:0.0:1787582748.758132:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787582748.758139:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186208384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582748.758185:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483512300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186208384:12345-0@lo:400:kworker.0 Request processed in 46us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582748.758191:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787582748.758209:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787582748.758215:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186208256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582748.758242:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483512680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186208256:12345-0@lo:400:kworker.0 Request processed in 28us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582748.758248:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787582748.758267:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787582748.758273:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186208000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582748.758307:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483513b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186208000:12345-0@lo:400:kworker.0 Request processed in 34us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582748.758313:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787582748.758360:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186208512 00000100:00100000:0.0:1787582748.758363:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186208512 00000100:00100000:0.0:1787582748.758386:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186208128 00000100:00100000:0.0:1787582748.758389:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186208128 00000100:00100000:0.0:1787582748.758406:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787582748.758411:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186208512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582748.758441:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186208512:12345-0@lo:400:kworker.0 Request processed in 30us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582748.758447:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787582748.758458:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787582748.758464:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186208128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582748.759489:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186207872 00000100:00100000:1.0:1787582748.759503:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186207872 00000100:00100000:1.0:1787582748.759546:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787582748.759554:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186207872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582748.759599:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186207872:12345-0@lo:400:kworker.0 Request processed in 47us (1868us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582748.759605:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787582748.760970:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186208128:12345-0@lo:400:kworker.0 Request processed in 2501us (2946us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582748.760981:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1787582748.761011:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787582748.761016:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582748.761051:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186208256:0@lo:400:kworker.0 00000100:00100000:0.0:1787582748.761063:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186208384:0@lo:400:kworker.0 00000100:00100000:0.0:1787582748.761072:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186207872:0@lo:400:kworker.0 00010000:00080000:0.0:1787582748.761105:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb684380 x1874416186208128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582748.761130:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186208128:0@lo:400:kworker.0 00000100:00100000:0.0:1787582748.761142:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186208000:0@lo:400:kworker.0 00010000:00080000:0.0:1787582748.761152:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb686a00 x1874416186208512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582748.761159:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186208512:0@lo:400:kworker.0 00010000:00010000:0.0:1787582749.139606:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582749.284890:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186208640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582749.284960:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582749.285031:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186208640 00000100:00100000:1.0:1787582749.285039:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186208640 00000100:00100000:1.0:1787582749.285088:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787582749.285099:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186208640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787582749.285137:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582749.285183:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186208640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582749.285189:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787582749.285241:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb686d80 x1874416186208640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582749.285260:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186208640:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1787582749.425837:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 83345526-3920-4b94-b598-4d9f74280322 00000001:00100000:0.0:1787582749.850639:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 83345526-3920-4b94-b598-4d9f74280322 00010000:00010000:2.0:1787582750.160442:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787582750.413146:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 83345526-3920-4b94-b598-4d9f74280322 00010000:00010000:3.0:1787582751.184486:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582752.208674:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582752.730087:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582752.730204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582752.730238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582752.730272:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582752.730299:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582752.730344:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162058496 00000100:00100000:2.0:1787582752.730354:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162058496 00000100:00100000:2.0:1787582752.730409:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162058368 00000100:00100000:2.0:1787582752.730412:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162058368 00000100:00100000:2.0:1787582752.730435:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 67 00000100:00100000:2.0:1787582752.730443:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83345526-3920-4b94-b598-4d9f74280322+5:2358:x1874416162058496:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582752.730504:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83345526-3920-4b94-b598-4d9f74280322+5:2358:x1874416162058496:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 61us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582752.730522:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 67 00000100:00100000:2.0:1787582752.730538:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 68 00000100:00100000:2.0:1787582752.730544:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162058368:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582752.730567:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162058368:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 24us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582752.730574:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 68 00000100:00100000:2.0:1787582752.730589:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162058752 00000100:00100000:2.0:1787582752.730593:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162058752 00000100:00100000:2.0:1787582752.730615:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162058624 00000100:00100000:2.0:1787582752.730618:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162058624 00000100:00100000:2.0:1787582752.730637:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 38 00000100:00100000:2.0:1787582752.730643:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83345526-3920-4b94-b598-4d9f74280322+5:2358:x1874416162058752:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582752.734393:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83345526-3920-4b94-b598-4d9f74280322+5:2358:x1874416162058752:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 3739us (4143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582752.734406:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 38 00000100:00100000:2.0:1787582752.734439:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 39 00000100:00100000:2.0:1787582752.734451:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83345526-3920-4b94-b598-4d9f74280322+5:2358:x1874416162058624:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582752.734476:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:83345526-3920-4b94-b598-4d9f74280322+5:2358:x1874416162058624:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 30us (4176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582752.734483:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 39 00000100:00080000:2.0:1787582752.734505:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787582752.734509:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787582752.734512:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582752.740489:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162058240 00000100:00100000:1.0:1787582752.740517:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162058240 00000100:00100000:1.0:1787582752.740583:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 221 00000100:00100000:1.0:1787582752.740592:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2358:x1874416162058240:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582752.740696:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2358:x1874416162058240:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 105us (10617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582752.740704:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 221 00000100:00100000:3.0:1787582752.849846:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da586c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186208768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787582752.849919:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582752.850345:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186208768 00000100:00100000:1.0:1787582752.850353:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186208768 00000100:00100000:1.0:1787582752.850427:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787582752.850444:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186208768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787582752.850475:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582752.850527:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186208768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582752.850535:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787582752.850658:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da586c7f480 x1874416186208768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582752.850686:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da586c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186208768:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787582752.850871:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787582753.233045:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787582753.760699:0:10328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg620-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1787582753.873073:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186208896:0@lo:400:kworker.0 00000100:00100000:1.0:1787582753.873138:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582753.873166:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186208896 00000100:00100000:3.0:1787582753.873173:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186208896 00000100:00100000:3.0:1787582753.873218:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787582753.873226:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186208896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582753.873928:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186209280:0@lo:400:kworker.0 00000100:00100000:0.0:1787582753.873982:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582753.874031:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787582753.874037:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186209408:0@lo:400:kworker.0 00000100:00100000:0.0:1787582753.874060:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582753.874181:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186208896:12345-0@lo:400:kworker.0 Request processed in 953us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582753.874190:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787582753.874544:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186209280 00000100:00100000:3.0:1787582753.874551:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186209280 00000100:00100000:3.0:1787582753.874750:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186209408 00000100:00100000:3.0:1787582753.874763:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186209408 00000100:00100000:3.0:1787582753.874790:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787582753.874797:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186209280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582753.874845:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186209280:12345-0@lo:400:kworker.0 Request processed in 48us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582753.874850:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787582753.874862:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787582753.874868:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186209408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582753.874893:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186209408:12345-0@lo:400:kworker.0 Request processed in 26us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582753.874898:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787582753.874982:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186209408:0@lo:400:kworker.0 00000100:00100000:3.0:1787582753.874992:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186209280:0@lo:400:kworker.0 00000100:00080000:0.0:1787582753.875067:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582753.875372:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186209024:0@lo:400:kworker.0 00000100:00100000:0.0:1787582753.875405:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582753.875430:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186209536:0@lo:400:kworker.0 00000100:00100000:0.0:1787582753.875456:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582753.875475:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582753.875481:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186209152:0@lo:400:kworker.0 00000100:00100000:0.0:1787582753.875514:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582753.875544:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186209536 00000100:00100000:0.0:1787582753.875549:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186209536 00000100:00100000:0.0:1787582753.875579:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186209152 00000100:00100000:0.0:1787582753.875582:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186209152 00000100:00100000:0.0:1787582753.875627:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787582753.875633:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58303cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186209536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582753.875756:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58303cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186209536:12345-0@lo:400:kworker.0 Request processed in 122us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582753.875762:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787582753.875887:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787582753.875894:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186209152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582753.875923:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186209152:12345-0@lo:400:kworker.0 Request processed in 30us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582753.875928:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787582753.875945:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787582753.875965:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da588495500 x1874416186209152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582753.875976:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186209152:0@lo:400:kworker.0 00010000:00080000:0.0:1787582753.875985:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adbcdf80 x1874416186209536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582753.875992:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186209536:0@lo:400:kworker.0 00000100:00100000:3.0:1787582753.876065:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186209024 00000100:00100000:3.0:1787582753.876069:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186209024 00000100:00100000:3.0:1787582753.876102:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787582753.876109:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186209024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582753.876145:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186209024:12345-0@lo:400:kworker.0 Request processed in 37us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582753.876150:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787582753.876175:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186209024:0@lo:400:kworker.0 00000100:00100000:1.0:1787582753.876275:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588495c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186208896:0@lo:400:kworker.0 00010000:00010000:2.0:1787582754.256426:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582754.384618:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186209664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582754.384683:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582754.384930:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186209664 00000100:00100000:3.0:1787582754.384937:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186209664 00000100:00100000:3.0:1787582754.384985:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787582754.384995:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186209664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787582754.385041:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582754.385104:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186209664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582754.385111:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787582754.386060:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb686d80 x1874416186209664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582754.386084:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186209664:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787582755.286339:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582756.304569:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582757.331271:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582757.843527:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582757.843572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582757.843613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582757.843641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582757.843740:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582757.843775:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162059392 00000100:00100000:2.0:1787582757.843785:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162059392 00000100:00100000:2.0:1787582757.843854:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162059264 00000100:00100000:2.0:1787582757.843857:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162059264 00000100:00100000:3.0:1787582757.844075:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162058880 00000100:00100000:3.0:1787582757.844089:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162058880 00000100:00100000:3.0:1787582757.844147:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 223 00000100:00100000:3.0:1787582757.844159:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2357:x1874416162058880:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582757.844191:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162059136 00000100:00100000:1.0:1787582757.844198:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162059136 00000100:00100000:1.0:1787582757.844238:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162059008 00000100:00100000:1.0:1787582757.844241:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162059008 00000100:00100000:3.0:1787582757.844265:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2357:x1874416162058880:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 106us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582757.844276:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 72 00000100:00100000:3.0:1787582757.844278:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 223 00000100:00100000:1.0:1787582757.844293:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162059136:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582757.844385:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162059136:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 96us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582757.844393:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 72 00000100:00100000:1.0:1787582757.844425:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 73 00000100:00100000:1.0:1787582757.844431:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162059008:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582757.844454:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162059008:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 24us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582757.844460:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 73 00000100:00100000:2.0:1787582757.844517:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 42 00000100:00100000:2.0:1787582757.844529:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162059392:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582757.844553:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162059392:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 27us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582757.844558:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 42 00000100:00100000:2.0:1787582757.844569:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 43 00000100:00100000:2.0:1787582757.844575:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83345526-3920-4b94-b598-4d9f74280322+5:2358:x1874416162059264:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582757.844594:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83345526-3920-4b94-b598-4d9f74280322+5:2358:x1874416162059264:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 19us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582757.844598:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 43 00000100:00080000:2.0:1787582757.844617:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787582757.844621:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787582757.844623:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787582757.969146:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186209792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787582757.969238:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582757.969400:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186209792 00000100:00100000:0.0:1787582757.969410:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186209792 00000100:00100000:0.0:1787582757.969481:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787582757.969491:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf87aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186209792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787582757.969533:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582757.969582:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf87aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186209792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582757.969591:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787582757.969706:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787582757.969740:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bf225f80 x1874416186209792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582757.969772:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186209792:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787582758.356621:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582758.993692:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf87b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186210048:0@lo:400:kworker.0 00000100:00100000:1.0:1787582758.993740:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf87ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186209920:0@lo:400:kworker.0 00000100:00100000:0.0:1787582758.993808:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186210304:0@lo:400:kworker.0 00000100:00100000:2.0:1787582758.995611:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582758.995687:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf87b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186210560:0@lo:400:kworker.0 00000100:00100000:2.0:1787582758.996634:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582758.996684:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787582758.996692:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186210176:0@lo:400:kworker.0 00000100:00100000:2.0:1787582758.997634:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582758.997689:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186210560 00000100:00100000:3.0:1787582758.997855:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186210048 00000100:00100000:3.0:1787582758.997861:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186210048 00000100:00100000:3.0:1787582758.998022:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787582758.998032:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186210048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582758.998091:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186210048:12345-0@lo:400:kworker.0 Request processed in 61us (2484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582758.998114:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787582758.999723:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186210560 00000100:00100000:2.0:1787582758.999780:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186210176 00000100:00100000:2.0:1787582758.999785:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186210176 00000100:00100000:2.0:1787582758.999875:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787582758.999883:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186210560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582759.000011:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186210560:12345-0@lo:400:kworker.0 Request processed in 63us (3313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582759.000019:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787582759.000036:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787582759.000042:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186210176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582759.000072:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186210176:12345-0@lo:400:kworker.0 Request processed in 30us (2439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582759.000077:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1787582759.000106:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787582759.000139:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bf879880 x1874416186210176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582759.000153:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186210176:0@lo:400:kworker.0 00000100:00100000:2.0:1787582759.000164:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf87b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186210048:0@lo:400:kworker.0 00010000:00080000:2.0:1787582759.000176:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bf87b480 x1874416186210560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582759.000193:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf87b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186210560:0@lo:400:kworker.0 00000100:00100000:0.0:1787582759.002159:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582759.002209:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186210304 00000100:00100000:0.0:1787582759.002217:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186210304 00000100:00100000:0.0:1787582759.002265:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787582759.002274:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186210304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582759.002353:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186210304:12345-0@lo:400:kworker.0 Request processed in 80us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582759.002360:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787582759.002379:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582759.002417:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186210304:0@lo:400:kworker.0 00000100:00100000:1.0:1787582759.011105:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582759.011178:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186210432:0@lo:400:kworker.0 00000100:00100000:1.0:1787582759.011224:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582759.011266:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186210432 00000100:00100000:1.0:1787582759.011272:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186210432 00000100:00100000:0.0:1787582759.011701:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186209920 00000100:00100000:0.0:1787582759.011706:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186209920 00000100:00100000:0.0:1787582759.011742:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787582759.011750:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186209920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582759.011813:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186209920:12345-0@lo:400:kworker.0 Request processed in 62us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582759.011819:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787582759.020440:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf87ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186209920:0@lo:400:kworker.0 00000100:00080000:0.0:1787582759.022236:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582759.023515:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787582759.023535:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186210432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582759.023625:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186210432:12345-0@lo:400:kworker.0 Request processed in 99us (12400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582759.023633:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787582759.023695:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186210432:0@lo:400:kworker.0 00010000:00010000:3.0:1787582759.379708:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582759.508400:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582759.508429:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186210688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582759.508529:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582759.508571:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186210688 00000100:00100000:3.0:1787582759.508581:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186210688 00000100:00100000:3.0:1787582759.508652:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787582759.508663:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186210688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787582759.508702:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582759.508753:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186210688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582759.508760:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787582759.508805:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb684000 x1874416186210688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582759.508823:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186210688:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787582760.401980:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582761.424578:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582762.448516:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582762.965208:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582762.965263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582762.965297:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162059904 00000100:00100000:1.0:1787582762.965309:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162059904 00000100:00100000:1.0:1787582762.965442:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 46 00000100:00100000:1.0:1787582762.965455:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83345526-3920-4b94-b598-4d9f74280322+5:2360:x1874416162059904:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582762.965571:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83345526-3920-4b94-b598-4d9f74280322+5:2360:x1874416162059904:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 118us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582762.965579:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 46 00000100:00080000:1.0:1787582762.965745:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582762.970027:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162059648 00000100:00100000:3.0:1787582762.970050:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162059648 00000100:00100000:3.0:1787582762.970256:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 77 00000100:00100000:3.0:1787582762.970269:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2360:x1874416162059648:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582762.970400:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2360:x1874416162059648:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 133us (5205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582762.970410:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 77 00000100:00100000:3.0:1787582762.970500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582762.970660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582762.972380:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582762.972447:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162059776 00000100:00100000:3.0:1787582762.972476:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162059776 00000100:00100000:3.0:1787582762.972541:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 78 00000100:00100000:3.0:1787582762.972569:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83345526-3920-4b94-b598-4d9f74280322+5:2359:x1874416162059776:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582762.978086:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf87bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83345526-3920-4b94-b598-4d9f74280322+5:2359:x1874416162059776:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 5518us (7409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582762.978104:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 78 00000100:00100000:3.0:1787582762.978171:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162059520 00000100:00100000:3.0:1787582762.978182:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162059520 00000100:00100000:3.0:1787582762.978233:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 225 00000100:00100000:3.0:1787582762.978242:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2359:x1874416162059520:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582762.978276:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2359:x1874416162059520:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 35us (7776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582762.978283:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 225 00000100:00100000:3.0:1787582762.978341:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162060032 00000100:00100000:3.0:1787582762.978346:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162060032 00000100:00100000:3.0:1787582762.978397:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 47 00000100:00100000:3.0:1787582762.978404:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf87a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83345526-3920-4b94-b598-4d9f74280322+5:2359:x1874416162060032:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582762.978436:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf87a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:83345526-3920-4b94-b598-4d9f74280322+5:2359:x1874416162060032:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 33us (6069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582762.978443:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 47 00000100:00080000:3.0:1787582762.978467:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787582762.978472:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582763.089938:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582763.089966:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186210816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582763.090066:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582763.090263:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186210816 00000100:00100000:3.0:1787582763.090273:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186210816 00000100:00100000:3.0:1787582763.090382:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787582763.090394:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186210816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787582763.090450:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582763.090521:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186210816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582763.090530:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787582763.090579:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb685500 x1874416186210816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582763.090623:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186210816:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787582763.091371:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787582763.479412:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582764.113183:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186210944:0@lo:400:kworker.0 00000100:00100000:1.0:1787582764.113281:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582764.117833:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf87ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186211072:0@lo:400:kworker.0 00000100:00100000:2.0:1787582764.117936:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582764.117996:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787582764.118004:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186211200:0@lo:400:kworker.0 00000100:00100000:2.0:1787582764.118039:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582764.118081:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf87b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186211328:0@lo:400:kworker.0 00000100:00100000:2.0:1787582764.118104:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582764.118139:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186211072 00000100:00100000:2.0:1787582764.118148:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186211072 00000100:00100000:2.0:1787582764.118197:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186211328 00000100:00100000:2.0:1787582764.118199:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186211328 00000100:00100000:2.0:1787582764.118230:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787582764.118239:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186211072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582764.118293:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186211072:12345-0@lo:400:kworker.0 Request processed in 55us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582764.118301:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787582764.118335:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787582764.118341:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186211328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582764.118367:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186211328:12345-0@lo:400:kworker.0 Request processed in 26us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582764.118373:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1787582764.118394:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787582764.118426:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf87ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186211072:0@lo:400:kworker.0 00000100:00100000:2.0:1787582764.118450:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf87b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186211328:0@lo:400:kworker.0 00000100:00100000:1.0:1787582764.119926:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186211200 00000100:00100000:1.0:1787582764.119944:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186211200 00000100:00100000:1.0:1787582764.120008:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787582764.120018:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186211200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582764.120109:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186211200:12345-0@lo:400:kworker.0 Request processed in 92us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582764.120116:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787582764.120146:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787582764.120161:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186211584:0@lo:400:kworker.0 00000100:00100000:1.0:1787582764.120161:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf87b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186211456:0@lo:400:kworker.0 00000100:00100000:3.0:1787582764.120199:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582764.120199:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582764.120234:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186210944 00000100:00100000:3.0:1787582764.120239:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186210944 00000100:00100000:3.0:1787582764.120282:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787582764.120290:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186210944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582764.120344:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186210944:12345-0@lo:400:kworker.0 Request processed in 55us (7063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582764.120350:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787582764.120538:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186210944:0@lo:400:kworker.0 00000100:00100000:3.0:1787582764.120674:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186211584 00000100:00100000:3.0:1787582764.120679:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186211584 00010000:00080000:2.0:1787582764.120713:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bf878000 x1874416186211200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582764.120721:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787582764.120728:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186211584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582764.120728:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186211200:0@lo:400:kworker.0 00000100:00100000:2.0:1787582764.120750:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186211456 00000100:00100000:2.0:1787582764.120754:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186211456 00000100:00100000:3.0:1787582764.120764:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf879f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186211584:12345-0@lo:400:kworker.0 Request processed in 36us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582764.120770:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787582764.120783:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787582764.120790:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186211456:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787582764.120797:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bf879880 x1874416186211584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582764.120825:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186211456:12345-0@lo:400:kworker.0 Request processed in 36us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582764.120828:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf879880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186211584:0@lo:400:kworker.0 00000100:00100000:2.0:1787582764.120831:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1787582764.120936:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787582764.120941:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787582764.120961:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf87b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186211456:0@lo:400:kworker.0 00010000:00010000:3.0:1787582764.498552:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582764.628821:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787582764.628845:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186211712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582764.628920:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582764.629250:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186211712 00000100:00100000:2.0:1787582764.629257:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186211712 00000100:00100000:2.0:1787582764.629304:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787582764.629313:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186211712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787582764.629373:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582764.629421:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186211712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582764.629428:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787582764.629470:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb685180 x1874416186211712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582764.629502:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186211712:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787582765.521752:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582766.557778:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582767.573524:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582768.094198:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582768.094241:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582768.094271:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582768.094290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582768.094334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582768.094361:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162060160 00000100:00100000:2.0:1787582768.094370:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162060160 00000100:00100000:2.0:1787582768.094422:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 227 00000100:00100000:2.0:1787582768.094430:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162060160:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582768.094488:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162060160:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 59us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582768.094496:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 227 00000100:00100000:2.0:1787582768.094523:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162060416 00000100:00100000:2.0:1787582768.094526:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162060416 00000100:00100000:2.0:1787582768.094552:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162060288 00000100:00100000:2.0:1787582768.094554:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162060288 00000100:00100000:2.0:1787582768.094707:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 82 00000100:00100000:2.0:1787582768.094714:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83345526-3920-4b94-b598-4d9f74280322+5:2360:x1874416162060416:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582768.094742:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83345526-3920-4b94-b598-4d9f74280322+5:2360:x1874416162060416:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 29us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582768.094748:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 82 00000100:00100000:2.0:1787582768.094758:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 83 00000100:00100000:2.0:1787582768.094763:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2360:x1874416162060288:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582768.094780:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2360:x1874416162060288:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 17us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582768.094786:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 83 00000100:00100000:2.0:1787582768.094803:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162060544 00000100:00100000:2.0:1787582768.094811:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162060544 00000100:00100000:2.0:1787582768.094834:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162060672 00000100:00100000:2.0:1787582768.094836:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162060672 00000100:00100000:2.0:1787582768.094862:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 15 00000100:00100000:2.0:1787582768.094868:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83345526-3920-4b94-b598-4d9f74280322+5:2356:x1874416162060544:12345-192.168.206.20@tcp:9:kworker.0 00000020:00000080:2.0:1787582768.094884:0:8218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537cec 00000100:00080000:2.0:1787582768.094891:0:8218:0:(import.c:65:import_set_state_nolock()) ffff8da5855d0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787582768.094923:0:8218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787582768.095174:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83345526-3920-4b94-b598-4d9f74280322+2:2356:x1874416162060544:12345-192.168.206.20@tcp:9:kworker.0 Request processed in 305us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582768.095180:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 15 00000100:00100000:2.0:1787582768.095191:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:2.0:1787582768.095197:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83345526-3920-4b94-b598-4d9f74280322+5:2356:x1874416162060672:12345-192.168.206.20@tcp:9:kworker.0 00000020:00000080:2.0:1787582768.095207:0:8218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537cf3 00000100:00080000:2.0:1787582768.095211:0:8218:0:(import.c:65:import_set_state_nolock()) ffff8da5855d1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787582768.095232:0:8218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787582768.096274:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:83345526-3920-4b94-b598-4d9f74280322+2:2356:x1874416162060672:12345-192.168.206.20@tcp:9:kworker.0 Request processed in 1074us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582768.096282:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00080000:2.0:1787582768.096835:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787582768.096839:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787582768.096985:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787582768.096996:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582768.097001:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582768.208805:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787582768.208826:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186211840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787582768.208909:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582768.209060:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186211840 00000100:00100000:1.0:1787582768.209069:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186211840 00000100:00100000:1.0:1787582768.209120:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787582768.209129:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186211840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787582768.209163:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582768.209221:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186211840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582768.209228:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787582768.209255:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787582768.209345:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb684a80 x1874416186211840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582768.209361:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186211840:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787582768.593768:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582769.234689:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186211968:0@lo:400:kworker.0 00000100:00100000:3.0:1787582769.234757:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582769.234809:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186212480:0@lo:400:kworker.0 00000100:00100000:3.0:1787582769.234837:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582769.234860:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787582769.234866:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186212352:0@lo:400:kworker.0 00000100:00100000:3.0:1787582769.234887:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582769.234911:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186212224:0@lo:400:kworker.0 00000100:00100000:3.0:1787582769.234936:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582769.234951:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787582769.234957:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186212096:0@lo:400:kworker.0 00000100:00100000:3.0:1787582769.234977:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582769.234995:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186212608:0@lo:400:kworker.0 00000100:00100000:3.0:1787582769.235015:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582769.235040:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186212480 00000100:00100000:3.0:1787582769.235046:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186212480 00000100:00100000:3.0:1787582769.235091:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186212352 00000100:00100000:3.0:1787582769.235095:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186212352 00000100:00100000:3.0:1787582769.235111:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186212096 00000100:00100000:3.0:1787582769.235123:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186212096 00000100:00100000:3.0:1787582769.235143:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787582769.235152:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186212480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582769.235200:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186212480:12345-0@lo:400:kworker.0 Request processed in 49us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582769.235206:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787582769.235223:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787582769.235229:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186212352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582769.235256:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186212352:12345-0@lo:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582769.235261:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787582769.235272:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787582769.235278:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186212096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582769.235308:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf87b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186212096:12345-0@lo:400:kworker.0 Request processed in 30us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582769.235313:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1787582769.235357:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582769.235387:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186212096:0@lo:400:kworker.0 00000100:00100000:3.0:1787582769.235417:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186212352:0@lo:400:kworker.0 00000100:00100000:3.0:1787582769.235426:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186212480:0@lo:400:kworker.0 00000100:00100000:1.0:1787582769.235490:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186211968 00000100:00100000:1.0:1787582769.235495:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186211968 00000100:00100000:1.0:1787582769.235533:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787582769.235540:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186211968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582769.235598:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186211968:12345-0@lo:400:kworker.0 Request processed in 58us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582769.235604:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787582769.235757:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186212224 00000100:00100000:2.0:1787582769.235762:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186212224 00000100:00100000:2.0:1787582769.235796:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186212608 00000100:00100000:2.0:1787582769.235807:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186212608 00000100:00100000:2.0:1787582769.235838:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787582769.235845:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186212224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582769.235884:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186212224:12345-0@lo:400:kworker.0 Request processed in 39us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582769.235890:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787582769.235903:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787582769.235909:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186212608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582769.235937:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186212608:12345-0@lo:400:kworker.0 Request processed in 28us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582769.235943:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1787582769.235961:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787582769.235981:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb684000 x1874416186212608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582769.235993:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186212608:0@lo:400:kworker.0 00010000:00080000:2.0:1787582769.236003:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb684a80 x1874416186212224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582769.236012:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186212224:0@lo:400:kworker.0 00000100:00100000:3.0:1787582769.236101:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186211968:0@lo:400:kworker.0 00010000:00010000:2.0:1787582769.616464:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582769.749171:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186212736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582769.749243:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582769.749479:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186212736 00000100:00100000:3.0:1787582769.749490:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186212736 00000100:00100000:3.0:1787582769.749542:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787582769.749552:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186212736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787582769.749612:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582769.749663:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186212736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582769.749670:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787582769.752926:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bf87a300 x1874416186212736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582769.752951:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf87a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186212736:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1787582769.832614:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 83345526-3920-4b94-b598-4d9f74280322 00000020:00000080:2.0:1787582769.832632:0:7656:0:(genops.c:885:class_export_put()) final put ffff8da5855d0800/83345526-3920-4b94-b598-4d9f74280322 00000020:00000080:2.0:1787582769.832655:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5855d0800/83345526-3920-4b94-b598-4d9f74280322 for lustre-OST0001 00000020:00000080:2.0:1787582769.833258:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5855d1800 for lustre-OST0001 00010000:00010000:2.0:1787582770.640807:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787582770.870409:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 83345526-3920-4b94-b598-4d9f74280322 00000020:00000080:3.0:1787582770.870418:0:6733:0:(genops.c:885:class_export_put()) final put ffff8da5855d3800/83345526-3920-4b94-b598-4d9f74280322 00000020:00000080:2.0:1787582770.870492:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5855d3800/83345526-3920-4b94-b598-4d9f74280322 for lustre-OST0000 00000020:00000080:2.0:1787582770.870539:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5855d0000 for lustre-OST0000 00010000:00010000:2.0:1787582771.672428:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787582772.089336:0:11030:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787582772.688546:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582773.204544:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582773.204625:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162060800 00000100:00100000:2.0:1787582773.204638:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162060800 00000100:00100000:3.0:1787582773.204661:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582773.204692:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582773.204702:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 229 00000100:00100000:3.0:1787582773.204714:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162061056 00000100:00100000:2.0:1787582773.204714:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2359:x1874416162060800:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582773.204717:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162061056 00000100:00100000:3.0:1787582773.204757:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162060928 00000100:00100000:3.0:1787582773.204760:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162060928 00000100:00100000:3.0:1787582773.204780:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 87 00000100:00100000:3.0:1787582773.204787:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+5:2359:x1874416162061056:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582773.204815:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2359:x1874416162060800:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 104us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582773.204819:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf87b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+5:2359:x1874416162061056:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 33us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582773.204823:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 229 00000100:00100000:3.0:1787582773.204825:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 87 00000100:00100000:3.0:1787582773.204841:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 88 00000100:00100000:3.0:1787582773.204845:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf87ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162060928:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582773.204868:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf87ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162060928:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 22us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582773.204873:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 88 00000100:00080000:3.0:1787582773.204892:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582773.336936:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787582773.336965:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186212864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787582773.337049:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582773.337127:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186212864 00000100:00100000:0.0:1787582773.337136:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186212864 00000100:00100000:0.0:1787582773.337210:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787582773.337221:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186212864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787582773.337266:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582773.338461:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186212864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1233us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582773.338473:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1787582773.338520:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787582773.338767:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bf225c00 x1874416186212864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582773.338794:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186212864:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787582773.714471:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582774.353215:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da589c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186213376:0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.353303:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582774.353402:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787582774.353408:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da589c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186212992:0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.353444:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582774.353470:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da589c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186213504:0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.353509:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582774.353540:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da589c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186213120:0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.353580:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582774.353599:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da589c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186213632:0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.353637:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582774.353664:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787582774.353670:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da589c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186213248:0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.353694:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582774.353810:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186213376 00000100:00100000:2.0:1787582774.353819:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186213376 00000100:00100000:2.0:1787582774.353880:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186213504 00000100:00100000:2.0:1787582774.353883:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186213504 00000100:00100000:2.0:1787582774.353898:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186213120 00000100:00100000:2.0:1787582774.353900:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186213120 00000100:00100000:2.0:1787582774.353915:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787582774.353924:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186213376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.353987:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186213376:12345-0@lo:400:kworker.0 Request processed in 63us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582774.353996:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787582774.354016:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787582774.354022:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186213504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.354047:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186213504:12345-0@lo:400:kworker.0 Request processed in 26us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582774.354053:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787582774.354062:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787582774.354067:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186213120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.354109:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186213120:12345-0@lo:400:kworker.0 Request processed in 41us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582774.354115:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787582774.354134:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186212992 00000100:00100000:2.0:1787582774.354138:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186212992 00000100:00100000:2.0:1787582774.354162:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787582774.354169:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186212992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.354198:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186212992:12345-0@lo:400:kworker.0 Request processed in 29us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582774.354204:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787582774.354241:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186213632 00000100:00100000:2.0:1787582774.354245:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186213632 00000100:00100000:2.0:1787582774.354271:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186213248 00000100:00100000:2.0:1787582774.354273:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186213248 00000100:00100000:2.0:1787582774.354290:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787582774.354297:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186213632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.354360:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186213632:12345-0@lo:400:kworker.0 Request processed in 63us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582774.354367:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787582774.354378:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787582774.354384:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186213248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.354413:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186213248:12345-0@lo:400:kworker.0 Request processed in 29us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582774.354419:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1787582774.354438:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787582774.354444:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787582774.354484:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da589c7d880 x1874416186213248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582774.354510:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da589c7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186213248:0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.354525:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da589c7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186213120:0@lo:400:kworker.0 00010000:00080000:2.0:1787582774.354535:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da589c7f480 x1874416186213632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582774.354543:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da589c7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186213632:0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.354590:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da589c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186212992:0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.354602:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da589c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186213504:0@lo:400:kworker.0 00000100:00100000:2.0:1787582774.354613:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da589c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186213376:0@lo:400:kworker.0 00010000:00010000:2.0:1787582774.738752:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582774.865068:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582774.865096:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186213760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787582774.865179:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582774.865278:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186213760 00000100:00100000:1.0:1787582774.865288:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186213760 00000100:00100000:1.0:1787582774.865369:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787582774.865380:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186213760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787582774.865419:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582774.865467:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186213760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582774.865474:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787582774.865512:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb684e00 x1874416186213760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582774.865531:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186213760:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1787582775.520504:0:11177:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb0f80fc0 20000000:00000080:2.0:1787582775.520530:0:11177:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8da5bf399c00 uarg=0000000000000000 20000000:01000000:2.0:1787582775.520589:0:11177:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787582775.520597:0:11177:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787582775.520604:0:11177:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787582775.522718:0:11178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1787582775.523019:0:11177:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787582775.536956:0:11177:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787582775.537013:0:11177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8da5a08d1c00/0xa113d808b7537cfa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.537036:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5b4e9de00/0xa113d808b7537ca6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537c9f expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.537045:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5b4e9c000/0xa113d808b7537cb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537cad expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.537052:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5b4e9ce00/0xa113d808b7537cc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537cbb expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.537062:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da580031400/0xa113d808b7537cc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ef9 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.537070:0:11177:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5bb6b7000/0xa113d808b7537cde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f31 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.537079:0:11177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8da5a08d1c00/0xa113d808b7537cfa lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.537136:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5bb6b7000/0xa113d808b7537cde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f31 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.537155:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da5bb6b7000/0xa113d808b7537cde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f31 expref: 12 pid: 5848 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582775.537173:0:11177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf87a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874416186213888:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582775.537313:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da580031400/0xa113d808b7537cc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ef9 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.537362:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da580031400/0xa113d808b7537cc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ef9 expref: 12 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582775.537372:0:11177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588495c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874416186214016:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582775.537408:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5b4e9ce00/0xa113d808b7537cc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537cbb expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.537416:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da5b4e9ce00/0xa113d808b7537cc2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537cbb expref: 18 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582775.537425:0:11177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588495180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874416186214144:0@lo:104: 00000100:00100000:3.0:1787582775.537474:0:11177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582775.537611:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186214144 00000100:00100000:0.0:1787582775.537623:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186214144 00000100:00100000:0.0:1787582775.537685:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787582775.537697:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+3:11177:x1874416186214144:12345-0@lo:104: 00010000:00010000:0.0:1787582775.537712:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537cbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537cc2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582775.537775:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787582775.537783:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+3:11177:x1874416186214144:12345-0@lo:104: Request processed in 88us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582775.537790:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787582775.537817:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582775.537826:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537cbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537cc2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.537835:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9da00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1787582775.537839:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537cbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537cc2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.537849:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537cbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537cc2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582775.537866:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537cbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537cc2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582775.537873:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787582775.537920:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537cbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537cc2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.537928:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582775.537953:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537cbb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537cc2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.537962:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537cbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537cc2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.537979:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582775.537981:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582775.537983:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582775.537998:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da589c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186214272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787582775.538037:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582775.538137:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186214272 00000100:00100000:1.0:1787582775.538142:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186214272 00010000:00010000:1.0:1787582775.538166:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5b4e9ce00/0xa113d808b7537cc2 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537cbb expref: 19 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582775.538240:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787582775.538249:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5911aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186214272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787582775.538271:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582775.538277:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5b4e9ce00/0xa113d808b7537cc2 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537cbb expref: 19 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582775.538288:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5b4e9ce00/0xa113d808b7537cc2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537cbb expref: 19 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582775.538306:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582775.538368:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5911aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186214272:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582775.538375:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787582775.540729:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da589c7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186214272:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787582775.542068:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5b4e9c000/0xa113d808b7537cb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537cad expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.542092:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da5b4e9c000/0xa113d808b7537cb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537cad expref: 18 pid: 5848 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582775.542111:0:11177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588496d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874416186214400:0@lo:104: 00000100:00100000:0.0:1787582775.546455:0:11177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787582775.546563:0:11177:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5b4e9de00/0xa113d808b7537ca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537c9f expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582775.546584:0:11177:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da5b4e9de00/0xa113d808b7537ca6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537c9f expref: 18 pid: 5848 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582775.546603:0:11177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf225180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874416186214528:0@lo:104: 00000100:00100000:0.0:1787582775.546636:0:11177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582775.546664:0:11177:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1d480 going to sleep for 11 seconds 00010000:00010000:0.0:1787582775.546694:0:11177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4e9ce00/0xa113d808b7537cc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537cbb expref: 18 pid: 5847 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582775.546696:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186214400 00000100:00100000:3.0:1787582775.546706:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186214400 00000100:00100000:0.0:1787582775.546714:0:11177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588495180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874416186214144:0@lo:104: 00000100:00100000:3.0:1787582775.546755:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186214528 00000100:00100000:3.0:1787582775.546759:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186214528 00000100:00100000:3.0:1787582775.546777:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787582775.546787:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf224a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+4:11177:x1874416186214400:12345-0@lo:104: 00010000:00010000:3.0:1787582775.546803:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d400/0xa113d808b7537cad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537cb4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582775.546896:0:11177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588496d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874416186214400:0@lo:104: 00010000:00010000:0.0:1787582775.546932:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787582775.546940:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf224a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+4:11177:x1874416186214400:12345-0@lo:104: Request processed in 154us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582775.546949:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787582775.546969:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787582775.546976:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:11177:x1874416186214528:12345-0@lo:104: 00010000:00010000:0.0:1787582775.546985:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b6200/0xa113d808b7537c9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582775.547027:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787582775.547033:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:11177:x1874416186214528:12345-0@lo:104: Request processed in 59us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582775.547039:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787582775.547065:0:11177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf225180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874416186214528:0@lo:104: 00010000:00010000:3.0:1787582775.547090:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787582775.547099:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d400/0xa113d808b7537cad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537cb4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.547109:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582775.547110:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9d400 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1787582775.547119:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d400/0xa113d808b7537cad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537cb4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.547129:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d400/0xa113d808b7537cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537cb4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582775.547138:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d400/0xa113d808b7537cad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537cb4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582775.547145:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787582775.547189:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d400/0xa113d808b7537cad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537cb4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.547196:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582775.547216:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d400/0xa113d808b7537cad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537cb4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.547224:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d400/0xa113d808b7537cad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537cb4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.547237:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582775.547239:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582775.547241:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582775.547562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582775.547659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582775.547688:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162061184 00000100:00100000:1.0:1787582775.547694:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162061184 00000100:00100000:3.0:1787582775.547698:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162061312 00000100:00100000:3.0:1787582775.547711:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162061312 00010000:00010000:1.0:1787582775.547723:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5bb6b7000/0xa113d808b7537cde lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f31 expref: 14 pid: 5848 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.547731:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da580031400/0xa113d808b7537cc9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ef9 expref: 14 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582775.547754:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 26 00000100:00100000:3.0:1787582775.547768:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 27 00000100:00100000:1.0:1787582775.547768:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+14:2360:x1874416162061184:12345-192.168.206.20@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787582775.547782:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb684a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9575074-4197-4fbd-89bc-d0d7fb5499a5+14:2360:x1874416162061312:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582775.547786:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582775.547795:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582775.547795:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5bb6b7000/0xa113d808b7537cde lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f31 expref: 14 pid: 5848 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582775.547811:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5bb6b7000/0xa113d808b7537cde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f31 expref: 14 pid: 5848 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582775.547842:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787582775.547861:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da580031400/0xa113d808b7537cc9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ef9 expref: 14 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.547875:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da580031400/0xa113d808b7537cc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ef9 expref: 14 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.547887:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582775.547908:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+14:2360:x1874416162061184:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 144us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582775.547916:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb684a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9575074-4197-4fbd-89bc-d0d7fb5499a5+14:2360:x1874416162061312:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 136us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582775.547920:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 26 00000100:00100000:3.0:1787582775.547930:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 27 00000100:00100000:1.0:1787582775.548044:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186214656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787582775.548081:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582775.548125:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186214656 00000100:00100000:1.0:1787582775.548129:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186214656 00010000:00010000:1.0:1787582775.548144:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5b4e9c000/0xa113d808b7537cb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537cad expref: 18 pid: 5848 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582775.548168:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787582775.548174:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:3312:x1874416186214656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787582775.548184:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582775.548189:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5b4e9c000/0xa113d808b7537cb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537cad expref: 18 pid: 5848 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582775.548197:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5b4e9c000/0xa113d808b7537cb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537cad expref: 18 pid: 5848 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582775.548208:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4e9c000/0xa113d808b7537cb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537cad expref: 18 pid: 5848 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582775.548218:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582775.548255:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:3312:x1874416186214656:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582775.548261:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787582775.548307:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186214656:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787582775.548478:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582775.548481:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582775.548483:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582775.548518:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b6200/0xa113d808b7537c9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548527:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6200 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1787582775.548531:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b6200/0xa113d808b7537c9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548539:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b6200/0xa113d808b7537c9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582775.548622:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b6200/0xa113d808b7537c9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582775.548628:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787582775.548673:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b6200/0xa113d808b7537c9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548679:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582775.548697:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b6200/0xa113d808b7537c9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548704:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b6200/0xa113d808b7537c9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548718:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582775.548720:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582775.548722:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582775.548728:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787582775.548739:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da589c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186214784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787582775.548772:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582775.548809:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186214784 00000100:00100000:2.0:1787582775.548814:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186214784 00010000:00010000:2.0:1787582775.548832:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5b4e9de00/0xa113d808b7537ca6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537c9f expref: 17 pid: 5848 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582775.548851:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787582775.548858:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:3314:x1874416186214784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787582775.548868:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582775.548878:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5b4e9de00/0xa113d808b7537ca6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537c9f expref: 17 pid: 5848 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548887:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5b4e9de00/0xa113d808b7537ca6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537c9f expref: 17 pid: 5848 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548898:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4e9de00/0xa113d808b7537ca6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537c9f expref: 17 pid: 5848 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548911:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8da5a08d1c00/0xa113d808b7537cfa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548920:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5a08d1c00/0xa113d808b7537cfa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548938:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5a08d1c00/0xa113d808b7537cfa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548946:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5a08d1c00/0xa113d808b7537cfa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548953:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8da5a08d1c00/0xa113d808b7537cfa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548960:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8da5a08d1c00/0xa113d808b7537cfa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548966:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1c00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582775.548970:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8da5a08d1c00/0xa113d808b7537cfa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548978:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8da5a08d1c00/0xa113d808b7537cfa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.548994:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8da5a08d1c00/0xa113d808b7537cfa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582775.549006:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582775.549043:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+16:3314:x1874416186214784:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582775.549049:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787582775.550002:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da589c7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186214784:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787582775.550147:0:11177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5bb6b7000/0xa113d808b7537cde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f31 expref: 12 pid: 5848 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582775.550162:0:11177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf87a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874416186213888:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582775.550174:0:11177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da580031400/0xa113d808b7537cc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ef9 expref: 11 pid: 5846 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582775.550181:0:11177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588495c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11177:1874416186214016:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582775.550214:0:11177:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8da5a08d1c00/0xa113d808b7537cfa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582775.550224:0:11177:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8da5a08d1c00/0xa113d808b7537cfa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582775.550248:0:11177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8da5a08d1c00/0xa113d808b7537cfa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582775.550254:0:11177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5a08d1c00/0xa113d808b7537cfa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582775.766407:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582776.667879:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582776.670059:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162061440 00000100:00100000:3.0:1787582776.670073:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162061440 00000100:00100000:3.0:1787582776.670131:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 231 00000100:00100000:3.0:1787582776.670141:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:5599:x1874416162061440:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582776.670156:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582776.670174:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5a08d1600/0xa113d808b7537d01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57f5b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.670211:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5a08d1600/0xa113d808b7537d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f5b expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.670222:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5a08d1600/0xa113d808b7537d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f5b expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.670231:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1600, rc 0) 00000100:00100000:3.0:1787582776.670290:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:5599:x1874416162061440:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 Request processed in 150us (2420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582776.670297:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 231 00000100:00100000:2.0:1787582776.675893:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582776.675963:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162061568 00000100:00100000:3.0:1787582776.675974:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162061568 00000100:00100000:3.0:1787582776.676035:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 232 00000100:00100000:3.0:1787582776.676045:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:5599:x1874416162061568:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582776.676343:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:5599:x1874416162061568:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 Request processed in 274us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582776.676351:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 232 00000100:00100000:3.0:1787582776.678636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582776.678777:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162061696 00000100:00100000:3.0:1787582776.678789:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162061696 00000100:00100000:3.0:1787582776.678859:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 233 00000100:00100000:3.0:1787582776.678875:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:5599:x1874416162061696:12345-192.168.206.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582776.679509:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:5599:x1874416162061696:12345-192.168.206.20@tcp:503:ll_cfg_requeue.0 Request processed in 630us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582776.679524:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 233 00000100:00100000:3.0:1787582776.686156:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582776.686240:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162061824 00000100:00100000:3.0:1787582776.686254:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162061824 00000100:00100000:3.0:1787582776.686357:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 234 00000100:00100000:3.0:1787582776.686370:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:5599:x1874416162061824:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582776.686392:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582776.686418:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5a08d0a00/0xa113d808b7537d08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57f62 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.686455:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5a08d0a00/0xa113d808b7537d08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f62 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.686469:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5a08d0a00/0xa113d808b7537d08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f62 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.686480:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0a00, rc 0) 00000100:00100000:3.0:1787582776.686577:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:5599:x1874416162061824:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 Request processed in 209us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582776.686585:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 234 00000100:00100000:0.0:1787582776.693036:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582776.693940:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162061952 00000100:00100000:3.0:1787582776.693961:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162061952 00000100:00100000:3.0:1787582776.694055:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 235 00000100:00100000:3.0:1787582776.694068:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:5599:x1874416162061952:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582776.694475:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:5599:x1874416162061952:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 Request processed in 409us (1445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582776.694485:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 235 00000100:00100000:3.0:1787582776.716634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582776.716760:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162062080 00000100:00100000:1.0:1787582776.716776:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162062080 00000100:00100000:1.0:1787582776.716839:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 236 00000100:00100000:1.0:1787582776.716850:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:5599:x1874416162062080:12345-192.168.206.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582776.717067:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:5599:x1874416162062080:12345-192.168.206.20@tcp:503:ll_cfg_requeue.0 Request processed in 218us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582776.717075:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 236 00010000:00010000:3.0:1787582776.788423:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787582776.848459:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787582776.848467:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da5bb7f0800 from 7 10000000:01000000:3.0:1787582776.848471:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787582776.848517:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0000/0xa113d808b7537d0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.848527:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0000/0xa113d808b7537d0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.848537:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0000/0xa113d808b7537d0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582776.848572:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186214912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787582776.848637:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582776.848693:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787582776.848805:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186214912 00000100:00100000:1.0:1787582776.848813:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186214912 00000100:00100000:1.0:1787582776.848865:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787582776.848874:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186214912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582776.848886:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582776.848897:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7537d16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537d0f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582776.848918:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7537d16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537d0f expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582776.848927:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7537d16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537d0f expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582776.848937:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6400, rc 0) 00000100:00100000:1.0:1787582776.848979:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186214912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582776.848987:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787582776.849092:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186214912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582776.849107:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0000/0xa113d808b7537d0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537d16 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.849115:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0000/0xa113d808b7537d0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537d16 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582776.849164:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582776.849189:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582776.849205:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582776.849299:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186215040 00000100:00100000:2.0:1787582776.849304:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186215040 00000100:00100000:2.0:1787582776.849353:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787582776.849360:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186215040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582776.849621:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186215040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582776.849629:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787582776.849787:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582776.849816:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582776.849860:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582776.849889:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1da80 going to sleep for 11 seconds 00000100:00100000:0.0:1787582776.849939:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186215168 00000100:00100000:0.0:1787582776.849943:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186215168 00000100:00100000:0.0:1787582776.849973:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1787582776.849980:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186215168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582776.850121:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186215168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582776.850128:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787582776.850246:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787582776.851082:0:11209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787582776.851233:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787582776.851251:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787582776.851260:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0000/0xa113d808b7537d0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537d16 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.851271:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0000/0xa113d808b7537d0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537d16 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582776.851280:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787582776.851283:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da5a1567000 from 7 10000000:01000000:3.0:1787582776.851285:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787582776.851309:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1400/0xa113d808b7537d1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.851354:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1400/0xa113d808b7537d1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.851365:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1400/0xa113d808b7537d1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582776.851383:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787582776.851422:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582776.851446:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582776.851506:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186215296 00000100:00100000:2.0:1787582776.851512:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186215296 00000100:00100000:2.0:1787582776.851552:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787582776.851560:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186215296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582776.851570:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582776.851581:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537d24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537d1d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582776.851600:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537d1d expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582776.851622:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537d1d expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582776.851631:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9d600, rc 0) 00000100:00100000:2.0:1787582776.851672:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186215296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582776.851679:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787582776.851793:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582776.851806:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1400/0xa113d808b7537d1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537d24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.851820:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1400/0xa113d808b7537d1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537d24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582776.851860:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582776.851883:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582776.851903:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787582776.851973:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186215424 00000100:00100000:1.0:1787582776.851978:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186215424 00000100:00100000:1.0:1787582776.852009:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787582776.852017:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186215424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582776.852214:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186215424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582776.852222:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787582776.852291:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582776.852338:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582776.852374:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582776.852390:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787582776.852499:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186215552 00000100:00100000:1.0:1787582776.852503:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186215552 00000100:00100000:1.0:1787582776.852530:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787582776.852537:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186215552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582776.852671:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186215552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582776.852678:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787582776.852752:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787582776.858178:0:11210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787582776.858352:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787582776.858373:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787582776.858384:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1400/0xa113d808b7537d1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537d24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582776.858396:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1400/0xa113d808b7537d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537d24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582776.858407:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787582776.858409:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da584c3b800 from 7 10000000:01000000:1.0:1787582776.858411:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787582776.858447:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7000/0xa113d808b7537d2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582776.858455:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7000/0xa113d808b7537d2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582776.858479:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7000/0xa113d808b7537d2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582776.858503:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb685500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787582776.858580:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582776.858622:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8e77180 going to sleep for 11 seconds 00000100:00100000:3.0:1787582776.858681:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186215680 00000100:00100000:3.0:1787582776.858689:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186215680 00000100:00100000:3.0:1787582776.858730:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787582776.858739:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186215680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582776.858751:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582776.858762:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5a08d1e00/0xa113d808b7537d32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537d2b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.858783:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5a08d1e00/0xa113d808b7537d32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537d2b expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.858793:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5a08d1e00/0xa113d808b7537d32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537d2b expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582776.858802:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1e00, rc 0) 00000100:00100000:3.0:1787582776.858847:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186215680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582776.858860:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1787582776.858937:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb685500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582776.858950:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7000/0xa113d808b7537d2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537d32 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582776.858958:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7000/0xa113d808b7537d2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537d32 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582776.859003:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb685500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582776.859027:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582776.859049:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8e77180 going to sleep for 11 seconds 00000100:00100000:2.0:1787582776.859104:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186215808 00000100:00100000:2.0:1787582776.859109:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186215808 00000100:00100000:2.0:1787582776.859140:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787582776.859147:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186215808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582776.859414:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186215808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582776.859421:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787582776.859555:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb685500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582776.859584:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb685500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582776.859620:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582776.859647:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8e77180 going to sleep for 11 seconds 00000100:00100000:2.0:1787582776.859692:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186215936 00000100:00100000:2.0:1787582776.859697:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186215936 00000100:00100000:2.0:1787582776.859726:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787582776.859732:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186215936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582776.859871:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186215936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582776.859878:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787582776.859969:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb685500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186215936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787582776.860755:0:11211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787582776.860900:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787582776.860914:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787582776.860924:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7000/0xa113d808b7537d2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537d32 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582776.860943:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7000/0xa113d808b7537d2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537d32 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582777.808440:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582778.323865:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582778.323908:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582778.323940:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582778.323968:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162062336 00000100:00100000:2.0:1787582778.323992:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162062336 00000100:00100000:2.0:1787582778.324044:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162062464 00000100:00100000:2.0:1787582778.324047:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162062464 00000100:00100000:2.0:1787582778.324071:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 92 00000100:00100000:2.0:1787582778.324080:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2357:x1874416162062336:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582778.324145:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2357:x1874416162062336:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 66us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582778.324153:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 92 00000100:00100000:2.0:1787582778.324169:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 93 00000100:00100000:2.0:1787582778.324175:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162062464:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582778.324201:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162062464:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 26us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582778.324208:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 93 00000100:00080000:2.0:1787582778.324223:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582778.324288:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162062208 00000100:00100000:1.0:1787582778.324292:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162062208 00000100:00100000:1.0:1787582778.324343:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 246 00000100:00100000:1.0:1787582778.324351:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2357:x1874416162062208:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582778.324376:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2357:x1874416162062208:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 27us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582778.324383:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 246 00000100:00100000:0.0:1787582778.450845:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582778.450867:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186216064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787582778.450933:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582778.450996:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186216064 00000100:00100000:0.0:1787582778.451003:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186216064 00000100:00100000:0.0:1787582778.451053:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787582778.451062:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186216064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787582778.451096:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582778.451139:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186216064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582778.451156:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787582778.451177:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787582778.451207:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bf225180 x1874416186216064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582778.451224:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186216064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787582778.840639:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582779.473679:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186216320:0@lo:400:kworker.0 00000100:00100000:3.0:1787582779.473739:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582779.473779:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186216832:0@lo:400:kworker.0 00000100:00100000:3.0:1787582779.473799:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582779.473824:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787582779.473829:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186216192:0@lo:400:kworker.0 00000100:00100000:3.0:1787582779.474602:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582779.474631:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186216704:0@lo:400:kworker.0 00000100:00100000:3.0:1787582779.474655:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582779.474685:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186216448:0@lo:400:kworker.0 00000100:00100000:3.0:1787582779.474707:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582779.474726:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787582779.474732:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186216576:0@lo:400:kworker.0 00000100:00100000:3.0:1787582779.474748:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582779.474777:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186216320 00000100:00100000:3.0:1787582779.474784:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186216320 00000100:00100000:3.0:1787582779.474818:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186216704 00000100:00100000:3.0:1787582779.474822:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186216704 00000100:00100000:3.0:1787582779.475370:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186216576 00000100:00100000:3.0:1787582779.475375:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186216576 00000100:00100000:3.0:1787582779.475394:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787582779.475402:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186216320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582779.475454:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186216320:12345-0@lo:400:kworker.0 Request processed in 52us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582779.475476:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787582779.475494:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787582779.475501:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186216704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582779.475544:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588495180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186216704:12345-0@lo:400:kworker.0 Request processed in 44us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582779.475551:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787582779.475562:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787582779.475569:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186216576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582779.475601:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186216576:12345-0@lo:400:kworker.0 Request processed in 32us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582779.475607:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787582779.475628:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186216832 00000100:00100000:3.0:1787582779.475631:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186216832 00000100:00100000:3.0:1787582779.475656:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186216448 00000100:00100000:3.0:1787582779.475659:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186216448 00000100:00100000:3.0:1787582779.475679:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787582779.475685:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186216832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582779.475717:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186216832:12345-0@lo:400:kworker.0 Request processed in 32us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582779.475724:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787582779.475734:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787582779.478191:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186216448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582779.478276:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186216448:12345-0@lo:400:kworker.0 Request processed in 2535us (3566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582779.478285:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787582779.478349:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186216192 00000100:00100000:3.0:1787582779.478356:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186216192 00000100:00100000:3.0:1787582779.478390:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787582779.478397:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186216192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582779.478428:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186216192:12345-0@lo:400:kworker.0 Request processed in 31us (3827us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582779.478433:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:3.0:1787582779.478472:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787582779.478477:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582779.478504:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186216192:0@lo:400:kworker.0 00000100:00100000:3.0:1787582779.478519:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588494380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186216704:0@lo:400:kworker.0 00000100:00100000:3.0:1787582779.478540:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186216320:0@lo:400:kworker.0 00010000:00080000:3.0:1787582779.478555:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da588497100 x1874416186216832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582779.478566:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186216832:0@lo:400:kworker.0 00000100:00100000:3.0:1787582779.478607:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186216576:0@lo:400:kworker.0 00010000:00080000:3.0:1787582779.478619:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da588494e00 x1874416186216448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582779.478627:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186216448:0@lo:400:kworker.0 00000001:02000400:2.0:1787582779.656114:0:11376:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg620-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787582779.857510:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582779.984658:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787582779.984680:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186216960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582779.984748:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582779.984824:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186216960 00000100:00100000:2.0:1787582779.984830:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186216960 00000100:00100000:2.0:1787582779.984874:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787582779.984884:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186216960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787582779.984917:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582779.984960:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186216960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582779.984967:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787582779.985025:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb685500 x1874416186216960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582779.985041:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186216960:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787582780.880892:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582781.907094:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582782.931041:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787582783.360199:0:11475:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:46:22 (1787582782) === 00000100:00100000:3.0:1787582783.450542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582783.450642:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582783.450683:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582783.450720:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162062848 00000100:00100000:3.0:1787582783.450733:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162062848 00000100:00100000:3.0:1787582783.450798:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162062720 00000100:00100000:3.0:1787582783.450801:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162062720 00000100:00100000:3.0:1787582783.450827:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 97 00000100:00100000:3.0:1787582783.450838:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162062848:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582783.450931:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162062848:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 95us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582783.450940:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 97 00000100:00100000:3.0:1787582783.450960:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 98 00000100:00100000:3.0:1787582783.450967:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162062720:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582783.450995:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162062720:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 29us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582783.451001:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 98 00000100:00080000:3.0:1787582783.451018:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787582783.457900:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162062592 00000100:00100000:2.0:1787582783.457916:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162062592 00000100:00100000:2.0:1787582783.458002:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 248 00000100:00100000:2.0:1787582783.458014:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2357:x1874416162062592:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582783.458110:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2357:x1874416162062592:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 98us (7582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582783.458119:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 248 00000100:00100000:0.0:1787582783.565553:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582783.565607:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582783.565669:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162062976 00000100:00100000:1.0:1787582783.565681:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162062976 00000100:00100000:1.0:1787582783.565747:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:1.0:1787582783.565758:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162062976:12345-192.168.206.20@tcp:41:mkdir.0 00000004:00000024:1.0:1787582783.565819:0:5855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787582783.566162:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162063104 00000100:00100000:2.0:1787582783.566168:0:5862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162063104 00000100:00100000:2.0:1787582783.566219:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 0 00000100:00100000:2.0:1787582783.566228:0:5862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:9690:x1874416162063104:12345-192.168.206.20@tcp:700:mkdir.0 00000100:00100000:2.0:1787582783.566344:0:5862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:9690:x1874416162063104:12345-192.168.206.20@tcp:700:mkdir.0 Request processed in 88us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582783.566354:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 0 00000100:00100000:0.0:1787582783.569358:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162062976:12345-192.168.206.20@tcp:41:mkdir.0 Request processed in 3540us (3753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582783.569376:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:1.0:1787582783.569607:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582783.569630:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186217088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582783.569694:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582783.569812:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186217088 00000100:00100000:2.0:1787582783.569823:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186217088 00000100:00100000:2.0:1787582783.569900:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787582783.569911:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186217088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582783.569963:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582783.570027:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186217088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582783.570034:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787582783.570836:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582783.570900:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162063360 00000100:00100000:2.0:1787582783.570908:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162063360 00000100:00100000:2.0:1787582783.570964:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 15 00000100:00100000:2.0:1787582783.570973:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:9690:x1874416162063360:12345-192.168.206.20@tcp:36:mkdir.0 00010000:00010000:2.0:1787582783.571034:0:7653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1787582783.571708:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787582783.571776:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb685180 x1874416186217088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582783.571803:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186217088:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787582783.576397:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef600/0xa113d808b7537c1a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ee4 expref: 6 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.576426:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da583acc100) 00010000:00010000:2.0:1787582783.576453:0:7653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787582783.576757:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d39 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.576770:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d39 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.576780:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d39 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.579870:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537d40 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.579895:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537d40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.579907:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537d40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582783.587799:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787582783.589004:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d39 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.589030:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d39 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.589038:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d39 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.589044:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9de00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582783.589049:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d39 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.589057:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d39 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.589074:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492c00) 00010000:00010000:2.0:1787582783.589077:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582783.589081:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d39 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.589088:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d39 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787582783.589966:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000487da8e7 reply state 00000000e95f6781 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537d40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582783.589980:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787582783.590084:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:9690:x1874416162063360:12345-192.168.206.20@tcp:36:mkdir.0 Request processed in 19108us (19250us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787582783.590092:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 15 00010000:00010000:3.0:1787582783.595286:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537d40 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.595304:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537d40 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.595312:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537d40 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.595338:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9da00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582783.595343:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537d40 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.595358:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537d40 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.595374:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8da5a4492900) 00010000:00010000:3.0:1787582783.595377:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582783.595381:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537d40 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.595387:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537d40 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582783.611826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582783.612027:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162063488 00000100:00100000:2.0:1787582783.612040:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162063488 00000100:00100000:2.0:1787582783.612128:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:2.0:1787582783.612140:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:9691:x1874416162063488:12345-192.168.206.20@tcp:101:chmod.0 00010000:00010000:2.0:1787582783.612168:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582783.612206:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57f69 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.612302:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537d4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.612583:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537d4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.612597:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537d4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582783.612675:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787582783.612680:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787582783.612730:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537d4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.612765:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f69 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.612787:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537d4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f69 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.612797:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492c00) 00010000:00010000:2.0:1787582783.612800:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787582783.612804:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9dc00, rc 0) 00000100:00100000:2.0:1787582783.612884:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:9691:x1874416162063488:12345-192.168.206.20@tcp:101:chmod.0 Request processed in 745us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582783.612901:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:2.0:1787582783.620775:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582783.620854:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162063744 00000100:00100000:0.0:1787582783.620871:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162063744 00000100:00100000:0.0:1787582783.620953:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 17 00000100:00100000:0.0:1787582783.620965:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:9691:x1874416162063744:12345-192.168.206.20@tcp:36:chmod.0 00010000:00010000:0.0:1787582783.621032:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582783.621068:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537d4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f69 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.621093:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492c00) 00010000:00010000:0.0:1787582783.621107:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787582783.621139:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537d55 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.621155:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537d55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.621195:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537d55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787582783.621853:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007bd64be0 reply state 00000000462db17c transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537d55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582783.621871:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787582783.621892:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787582783.623067:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:9691:x1874416162063744:12345-192.168.206.20@tcp:36:chmod.0 Request processed in 2093us (2300us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787582783.623079:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 17 00010000:00010000:2.0:1787582783.633723:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537d55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.633748:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537d55 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.633757:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537d55 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.633764:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580031a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582783.633769:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537d55 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.633778:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537d55 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.633800:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68500) 00010000:00010000:2.0:1787582783.633804:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787582783.633809:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537d55 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.633816:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537d55 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582783.685977:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582783.686383:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162063872 00000100:00100000:0.0:1787582783.686400:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162063872 00000100:00100000:0.0:1787582783.686495:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 18 00000100:00100000:0.0:1787582783.686519:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:9692:x1874416162063872:12345-192.168.206.20@tcp:101:chown.0 00010000:00010000:0.0:1787582783.686551:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582783.686581:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537d5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57f70 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.686668:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537d63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.686685:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537d63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.686698:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537d63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582783.686774:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787582783.686796:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582783.686851:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537d63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.686882:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537d5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f70 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.686903:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537d63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f70 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.686914:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68a00) 00010000:00010000:0.0:1787582783.686917:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787582783.686921:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580031e00, rc 0) 00000100:00100000:0.0:1787582783.687006:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:9692:x1874416162063872:12345-192.168.206.20@tcp:101:chown.0 Request processed in 501us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582783.687015:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 18 00000100:00100000:3.0:1787582783.700949:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582783.701029:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162064000 00000100:00100000:2.0:1787582783.701043:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162064000 00000100:00100000:2.0:1787582783.701118:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 19 00000100:00100000:2.0:1787582783.701129:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:9692:x1874416162064000:12345-192.168.206.20@tcp:101:chown.0 00010000:00010000:2.0:1787582783.701175:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582783.701214:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57f77 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701359:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537d71 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701377:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537d71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701391:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537d71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701408:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537d78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701427:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537d78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701436:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537d78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701576:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537d7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701585:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701593:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582783.701639:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787582783.701650:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787582783.701682:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537d7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701697:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537d71 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701704:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537d71 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701712:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537d71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701718:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9c000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582783.701724:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537d71 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701732:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537d71 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701746:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68a00) 00010000:00010000:2.0:1787582783.701749:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582783.701755:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537d71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701761:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537d71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701776:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537d78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701782:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537d78 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701798:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537d78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701803:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9ce00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582783.701806:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537d78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701812:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537d78 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701819:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8da5a4492200) 00010000:00010000:2.0:1787582783.701822:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582783.701825:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537d78 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701831:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537d78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701866:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f77 expref: 10 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701880:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537d7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f77 expref: 9 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582783.701888:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8da5a4492800) 00010000:00010000:2.0:1787582783.701890:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787582783.701892:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9d400, rc 0) 00000100:00100000:2.0:1787582783.701980:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:9692:x1874416162064000:12345-192.168.206.20@tcp:101:chown.0 Request processed in 853us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582783.701997:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 19 00000100:00100000:1.0:1787582783.711887:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582783.716430:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162064256 00000100:00100000:0.0:1787582783.716454:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162064256 00000100:00100000:0.0:1787582783.716664:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:0.0:1787582783.716678:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:9692:x1874416162064256:12345-192.168.206.20@tcp:36:chown.0 00010000:00010000:0.0:1787582783.716742:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582783.716774:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537d7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f77 expref: 9 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.716795:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8da5a4492800) 00010000:00010000:0.0:1787582783.716806:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787582783.716836:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537d86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.716871:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537d86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.716882:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537d86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787582783.769874:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1787582783.769966:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d694ca5c reply state 00000000a4a965ea transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537d86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582783.769982:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787582783.770423:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1787582783.770609:0:5855:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1787582783.770632:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:9692:x1874416162064256:12345-192.168.206.20@tcp:36:chown.0 Request processed in 53951us (58751us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787582783.770642:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 20 00010000:00010000:1.0:1787582783.770776:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537d86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.770795:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537d86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.770803:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537d86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.770810:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580031400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582783.770816:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537d86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.770825:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537d86 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.770846:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:1.0:1787582783.770850:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787582783.770856:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537d86 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.770863:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537d86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582783.797983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582783.798405:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162064384 00000100:00100000:2.0:1787582783.798418:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162064384 00000100:00100000:2.0:1787582783.798499:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 21 00000100:00100000:2.0:1787582783.798520:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:9693:x1874416162064384:12345-192.168.206.20@tcp:101:touch.500 00010000:00010000:2.0:1787582783.798560:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582783.798584:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57f7e expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787582783.802396:0:7653:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3747us 00010000:00010000:3.0:1787582783.830894:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1a00/0xa113d808b7537d94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.830920:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1a00/0xa113d808b7537d94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.830935:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1a00/0xa113d808b7537d94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.830955:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b7537d9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.830963:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b7537d9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.830970:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b7537d9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832097:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7537da2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832173:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7537da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832184:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7537da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582783.832698:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787582783.832706:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787582783.832815:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7537da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832832:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1a00/0xa113d808b7537d94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832839:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1a00/0xa113d808b7537d94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832846:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1a00/0xa113d808b7537d94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832853:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582783.832858:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1a00/0xa113d808b7537d94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832866:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1a00/0xa113d808b7537d94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832882:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68a00) 00010000:00010000:3.0:1787582783.832892:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582783.832898:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1a00/0xa113d808b7537d94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832904:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1a00/0xa113d808b7537d94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832918:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b7537d9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832924:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b7537d9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832930:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b7537d9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832935:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582783.832938:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b7537d9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832945:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b7537d9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832953:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8da583acc900) 00010000:00010000:3.0:1787582783.832956:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582783.832959:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b7537d9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.832966:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b7537d9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.833013:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9de00/0xa113d808b7537d8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f7e expref: 8 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.833173:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7537da2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f7e expref: 7 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.833181:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8da583acc600) 00010000:00010000:3.0:1787582783.833184:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787582783.833187:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1800, rc 0) 00000100:00100000:3.0:1787582783.833706:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:9693:x1874416162064384:12345-192.168.206.20@tcp:101:touch.500 Request processed in 35184us (35733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582783.833717:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 21 00000100:00100000:2.0:1787582783.837100:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582783.837983:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162064640 00000100:00100000:0.0:1787582783.837999:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162064640 00000100:00100000:0.0:1787582783.838221:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 22 00000100:00100000:0.0:1787582783.838234:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:9693:x1874416162064640:12345-192.168.206.20@tcp:101:touch.500 00010000:00010000:0.0:1787582783.838270:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582783.838296:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537da9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57f85 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.838865:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537db0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.838883:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537db0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.838910:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537db0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.838927:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537db7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.838935:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.838942:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787582783.843057:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787582783.843685:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b7537dbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.843702:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b7537dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.843726:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b7537dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.843765:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537db0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.843773:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537db0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.843779:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537db0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.843784:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580031a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582783.843788:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537db0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.843796:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537db0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.843808:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8da583acc600) 00010000:00010000:1.0:1787582783.843811:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582783.843816:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537db0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.843822:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537db0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787582783.843835:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d64a08a6 reply state 00000000dc34fd88 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582783.843844:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787582783.843885:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537da9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f85 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.843900:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b7537dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f85 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.843907:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8da58533f600) 00010000:00010000:1.0:1787582783.843909:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582783.843912:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7e00, rc 0) 00000100:00100000:1.0:1787582783.844049:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:9693:x1874416162064640:12345-192.168.206.20@tcp:101:touch.500 Request processed in 5816us (7025us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787582783.844058:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 22 00010000:00010000:1.0:1787582783.846484:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537db7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.846498:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537db7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.846521:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537db7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.846527:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580030e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582783.846532:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537db7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.846539:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537db7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.846554:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff8da5a0b68800) 00010000:00010000:1.0:1787582783.846557:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582783.846575:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537db7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.846581:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537db7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582783.848877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582783.848979:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162064896 00000100:00100000:0.0:1787582783.848992:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162064896 00000100:00100000:0.0:1787582783.849070:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 23 00000100:00100000:0.0:1787582783.849082:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:9693:x1874416162064896:12345-192.168.206.20@tcp:36:touch.500 00010000:00010000:0.0:1787582783.849164:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582783.849195:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b7537dbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f85 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.849216:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8da58533f600) 00010000:00010000:0.0:1787582783.849228:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787582783.849359:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537dcc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.849375:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537dcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.849385:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537dcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787582783.849643:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6492314 reply state 00000000916af508 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537dcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582783.849655:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787582783.849761:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:9693:x1874416162064896:12345-192.168.206.20@tcp:36:touch.500 Request processed in 681us (895us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787582783.849769:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 23 00010000:00010000:1.0:1787582783.853269:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537dcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.853290:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537dcc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.853297:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537dcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.853303:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580031800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582783.853308:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537dcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.853347:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537dcc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.853366:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8da5a0b68300) 00010000:00010000:1.0:1787582783.853369:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582783.853374:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537dcc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.853380:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537dcc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582783.856737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582783.856855:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162065024 00000100:00100000:3.0:1787582783.856867:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162065024 00000100:00100000:3.0:1787582783.856942:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 24 00000100:00100000:3.0:1787582783.856955:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:9693:x1874416162065024:12345-192.168.206.20@tcp:101:touch.500 00010000:00010000:3.0:1787582783.856984:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582783.857012:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b7537dd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57f8c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.857257:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b7537dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f8c expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.857274:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b7537dd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f8c expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.857298:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8da583acc900) 00010000:00010000:3.0:1787582783.857301:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787582783.857357:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0e00, rc 0) 00000100:00100000:3.0:1787582783.857435:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:9693:x1874416162065024:12345-192.168.206.20@tcp:101:touch.500 Request processed in 482us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582783.857443:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 24 00000100:00100000:2.0:1787582783.861990:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582783.862141:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162065152 00000100:00100000:3.0:1787582783.862153:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162065152 00000100:00100000:3.0:1787582783.862211:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 17 00000100:00100000:3.0:1787582783.862221:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1874416162065152:12345-192.168.206.20@tcp:8:touch.500 00010000:00080000:3.0:1787582783.862271:0:8218:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp t0 exp 0000000000000000 cur 324 last 0 00000020:00000080:3.0:1787582783.862309:0:8218:0:(genops.c:1385:class_connect()) connect: client 730f9f4f-46d8-441e-9162-5fde1074d6a5, cookie 0xa113d808b7537dda 00002000:00100000:3.0:1787582783.862367:0:8218:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 730f9f4f-46d8-441e-9162-5fde1074d6a5/ffff8da5bf27c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787582783.862382:0:8218:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787582783.864661:0:8218:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787582783.864722:0:8218:0:(import.c:65:import_set_state_nolock()) ffff8da5bf278800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787582783.864817:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2356:x1874416162065152:12345-192.168.206.20@tcp:8:touch.500 Request processed in 2594us (2837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582783.864830:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 17 00000100:00100000:2.0:1787582783.871868:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582783.872062:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162065280 00000100:00100000:3.0:1787582783.872075:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162065280 00000100:00100000:2.0:1787582783.872645:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 18 00000100:00100000:2.0:1787582783.872657:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:0:x1874416162065280:12345-192.168.206.20@tcp:2:touch.500 00000100:00080000:1.0:1787582783.873346:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787582783.938904:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1787582783.938928:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 730f9f4f-46d8-441e-9162-5fde1074d6a5 00000100:00100000:2.0:1787582783.939808:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:0:x1874416162065280:12345-192.168.206.20@tcp:2:touch.500 Request processed in 67145us (67943us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787582783.939821:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 18 00000100:00100000:2.0:1787582783.942802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582783.942922:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162065536 00000100:00100000:0.0:1787582783.942934:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162065536 00000100:00100000:1.0:1787582783.943182:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 2 00000100:00100000:1.0:1787582783.943197:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:9693:x1874416162065536:12345-192.168.206.20@tcp:35:touch.500 00000100:00100000:0.0:1787582783.943308:0:5856:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1787582783.943338:0:5856:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:1.0:1787582783.944574:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+11:9693:x1874416162065536:12345-192.168.206.20@tcp:35:touch.500 Request processed in 1373us (1832us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787582783.944588:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 2 00010000:00010000:2.0:1787582783.954030:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582783.959838:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582783.960001:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162065664 00000100:00100000:0.0:1787582783.960016:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162065664 00000100:00100000:0.0:1787582783.960091:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 25 00000100:00100000:0.0:1787582783.960104:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+11:9694:x1874416162065664:12345-192.168.206.20@tcp:101:rm.0 00010000:00010000:0.0:1787582783.960134:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582783.960162:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537de1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57f93 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.960249:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537de8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.960267:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.960280:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582783.960417:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787582783.960439:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582783.960612:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.960644:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537de1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f93 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.960665:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537de8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f93 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.960674:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8da583acc600) 00010000:00010000:0.0:1787582783.960677:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787582783.960681:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580030e00, rc 0) 00000100:00100000:0.0:1787582783.960757:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+12:9694:x1874416162065664:12345-192.168.206.20@tcp:101:rm.0 Request processed in 656us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582783.960765:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 25 00000100:00100000:2.0:1787582783.964679:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582783.964863:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162065920 00000100:00100000:1.0:1787582783.964875:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162065920 00000100:00100000:1.0:1787582783.964944:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 26 00000100:00100000:1.0:1787582783.964956:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+12:9694:x1874416162065920:12345-192.168.206.20@tcp:101:rm.0 00010000:00010000:1.0:1787582783.964980:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582783.965008:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7537def lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57f9a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582783.965155:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787582783.965436:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7537def lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f9a expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.965453:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68a00) 00010000:00010000:1.0:1787582783.965457:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787582783.965462:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7537def lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f9a expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582783.965834:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7a00, rc 0) 00000100:00100000:1.0:1787582783.965927:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:9694:x1874416162065920:12345-192.168.206.20@tcp:101:rm.0 Request processed in 971us (1260us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1787582783.965936:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 26 00000100:00100000:1.0:1787582783.970280:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582783.970426:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162066048 00000100:00100000:3.0:1787582783.970441:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162066048 00000100:00100000:3.0:1787582783.970536:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 3 00000100:00100000:3.0:1787582783.970548:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:9694:x1874416162066048:12345-192.168.206.20@tcp:37:rm.0 00000100:00100000:3.0:1787582783.974894:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:9694:x1874416162066048:12345-192.168.206.20@tcp:37:rm.0 Request processed in 4331us (4611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582783.974911:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 3 00000100:00100000:2.0:1787582783.979226:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582783.979880:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162066304 00000100:00100000:0.0:1787582783.979893:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162066304 00000100:00100000:0.0:1787582783.980010:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 4 00000100:00100000:0.0:1787582783.980023:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5836aa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:9694:x1874416162066304:12345-192.168.206.20@tcp:35:rm.0 00000100:00100000:0.0:1787582783.981061:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5836aa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:9694:x1874416162066304:12345-192.168.206.20@tcp:35:rm.0 Request processed in 1030us (1839us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787582783.981075:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 4 00000100:00100000:1.0:1787582783.985714:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582783.985853:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162066560 00000100:00100000:0.0:1787582783.985864:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162066560 00000100:00100000:0.0:1787582783.985969:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 27 00000100:00100000:0.0:1787582783.985982:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:9694:x1874416162066560:12345-192.168.206.20@tcp:101:rm.0 00010000:00010000:0.0:1787582783.986013:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582783.986057:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537dfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57fa1 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.986228:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537e04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.986257:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537e04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.986272:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537e04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582783.986286:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787582783.986787:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537dfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fa1 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.986813:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537e04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fa1 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582783.986824:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8da583acc600) 00010000:00010000:0.0:1787582783.986828:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787582783.986831:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580031400, rc 0) 00000100:00100000:0.0:1787582783.986913:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+16:9694:x1874416162066560:12345-192.168.206.20@tcp:101:rm.0 Request processed in 934us (1212us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787582783.986923:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 27 00000100:00100000:2.0:1787582783.991220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582783.991337:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162066688 00000100:00100000:1.0:1787582783.991351:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162066688 00000100:00100000:1.0:1787582783.991423:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 28 00000100:00100000:1.0:1787582783.991434:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+16:9694:x1874416162066688:12345-192.168.206.20@tcp:41:rm.0 00000004:00000024:1.0:1787582783.991523:0:5854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1787582783.991609:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+16:9694:x1874416162066688:12345-192.168.206.20@tcp:41:rm.0 Request processed in 176us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582783.991617:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 28 00000100:00100000:2.0:1787582783.994769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582783.994864:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162066816 00000100:00100000:3.0:1787582783.994876:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162066816 00000100:00100000:3.0:1787582783.994944:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 29 00000100:00100000:3.0:1787582783.994957:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+16:9694:x1874416162066816:12345-192.168.206.20@tcp:101:rm.0 00010000:00010000:3.0:1787582783.994981:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582783.995006:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1a00/0xa113d808b7537e12 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57fa8 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.995627:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7537e19 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.995649:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7537e19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.995665:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7537e19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.995682:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537e20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.995690:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.995698:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.995843:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b7537e27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.995869:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b7537e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.995878:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b7537e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582783.995913:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787582783.995918:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787582783.995940:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b7537e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.995954:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b7537e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.995963:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7537e19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.995971:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7537e19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.995979:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7537e19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.995986:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582783.995991:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7537e19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.995999:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7537e19 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.996014:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8da583acc600) 00010000:00010000:3.0:1787582783.996018:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582783.996242:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7537e19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.996346:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7537e19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.996364:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.996371:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537e20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.996378:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537e20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.996383:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582783.996386:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537e20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.996392:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537e20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.996402:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff8da583accb00) 00010000:00010000:3.0:1787582783.996405:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582783.996409:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537e20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.996640:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537e20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.996691:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1a00/0xa113d808b7537e12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fa8 expref: 18 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.996724:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b7537e27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fa8 expref: 17 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582783.996732:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8da583acc900) 00010000:00010000:3.0:1787582783.996737:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787582783.996740:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0c00, rc 0) 00000100:00100000:3.0:1787582783.996880:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+17:9694:x1874416162066816:12345-192.168.206.20@tcp:101:rm.0 Request processed in 1924us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582783.996890:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 29 00000100:00100000:2.0:1787582784.002202:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582784.002759:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162067072 00000100:00100000:3.0:1787582784.002772:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162067072 00000100:00100000:2.0:1787582784.002948:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 30 00000100:00100000:2.0:1787582784.002960:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+17:9694:x1874416162067072:12345-192.168.206.20@tcp:36:rm.0 00010000:00010000:2.0:1787582784.003037:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787582784.003071:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b7537e27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fa8 expref: 17 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.003097:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b7537dd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f8c expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.003122:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8da583acc900) 00010000:00010000:2.0:1787582784.003141:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537de8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f93 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.003151:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8da583acc600) 00010000:00010000:2.0:1787582784.003155:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787582784.003181:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537e2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.003198:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537e2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.003208:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537e2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.003226:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537e35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.003233:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.003687:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.003886:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537e3c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.003896:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537e3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.003903:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537e3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787582784.006006:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787582784.006037:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325012718390ns, next at 326012703962ns, rc = 0 00010000:00010000:2.0:1787582784.006237:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537e43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006708:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537e43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006725:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537e43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006736:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537e43 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006744:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537e43 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006750:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537e43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006841:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787582784.006876:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537e3c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006883:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537e3c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006890:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537e3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006896:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9d400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582784.006901:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537e3c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006908:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537e3c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006922:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8da5a4492500) 00010000:00010000:2.0:1787582784.006925:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787582784.006929:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537e3c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006936:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d400/0xa113d808b7537e3c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006958:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537e2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006963:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537e2e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006969:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537e2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006979:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9da00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582784.006982:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537e2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006988:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537e2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.006995:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8da583acc600) 00010000:00010000:2.0:1787582784.006997:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582784.007000:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537e2e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582784.007005:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9da00/0xa113d808b7537e2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787582784.007015:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c31ea7aa reply state 000000004c983de8 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582784.007025:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787582784.007159:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+16:9694:x1874416162067072:12345-192.168.206.20@tcp:36:rm.0 Request processed in 4197us (4966us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787582784.007170:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 30 00010000:00010000:3.0:1787582784.011108:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582784.011127:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537e43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582784.011140:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9ce00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582784.011144:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537e43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582784.011156:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537e43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582784.011179:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8da5a4492500) 00010000:00010000:3.0:1787582784.011237:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787582784.011244:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537e43 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582784.011250:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537e43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582784.011765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00010000:00010000:0.0:1787582784.011795:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582784.011797:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582784.011799:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582784.011851:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582784.011861:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537e35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582784.011868:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537e35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582784.011873:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9dc00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582784.011878:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537e35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582784.011885:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537e35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582784.011895:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff8da5a4492200) 00010000:00010000:1.0:1787582784.011897:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582784.011901:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537e35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582784.011908:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537e35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582784.011982:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162067328 00000100:00100000:3.0:1787582784.011995:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162067328 00000100:00100000:3.0:1787582784.012052:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 5 00000100:00100000:3.0:1787582784.012063:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:9694:x1874416162067328:12345-192.168.206.20@tcp:35:rm.0 00000100:00100000:2.0:1787582784.012901:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+16:9694:x1874416162067328:12345-192.168.206.20@tcp:35:rm.0 Request processed in 831us (1134us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787582784.012920:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 5 00000100:00100000:2.0:1787582784.019443:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582784.019708:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162067584 00000100:00100000:0.0:1787582784.019732:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162067584 00000100:00100000:0.0:1787582784.019868:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 31 00000100:00100000:0.0:1787582784.019882:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+16:9694:x1874416162067584:12345-192.168.206.20@tcp:36:rm.0 00010000:00010000:0.0:1787582784.019961:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787582784.019996:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537e04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fa1 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.020022:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7537da2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f7e expref: 15 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.020034:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8da583acc600) 00010000:00010000:0.0:1787582784.020051:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537d63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f70 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.020060:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68a00) 00010000:00010000:0.0:1787582784.020080:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787582784.020124:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537e4a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.020139:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537e4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.020150:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537e4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.020164:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537e51 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.020172:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537e51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.020190:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537e51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.020670:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537e58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.020680:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537e58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.020688:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537e58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582784.021396:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787582784.021416:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537e58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.021426:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537e58 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.021434:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537e58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.021440:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580031800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582784.021446:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537e58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.021455:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537e58 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.021467:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8da5a0b68200) 00010000:00010000:0.0:1787582784.021471:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787582784.021483:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537e58 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.021490:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031800/0xa113d808b7537e58 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.021527:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537e4a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.021534:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537e4a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.021541:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537e4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.021546:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580031a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582784.021549:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537e4a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.021555:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537e4a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.021563:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68e00) 00010000:00010000:0.0:1787582784.021565:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582784.021568:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537e4a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582784.021574:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537e4a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787582784.021586:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9bf0050 reply state 00000000ce49befc transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537e51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582784.021607:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787582784.021718:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:9694:x1874416162067584:12345-192.168.206.20@tcp:36:rm.0 Request processed in 1835us (2287us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787582784.021728:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 31 00010000:00010000:3.0:1787582784.027914:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537e51 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582784.027937:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537e51 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582784.027946:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537e51 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582784.027953:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580030e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582784.027959:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537e51 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582784.027968:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537e51 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582784.027989:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8da5a0b68400) 00010000:00010000:3.0:1787582784.027993:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582784.027998:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537e51 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582784.028004:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537e51 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582784.596120:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186217216:0@lo:400:kworker.0 00000100:00100000:1.0:1787582784.596227:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582784.596356:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186217216 00000100:00100000:0.0:1787582784.596366:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186217216 00000100:00100000:0.0:1787582784.596423:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787582784.596433:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186217216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582784.599031:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186217344:0@lo:400:kworker.0 00000100:00100000:3.0:1787582784.599123:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582784.599193:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186217344 00000100:00100000:3.0:1787582784.599201:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186217344 00000100:00100000:0.0:1787582784.599218:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186217216:12345-0@lo:400:kworker.0 Request processed in 2783us (2988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582784.599230:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787582784.599249:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787582784.599257:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186217344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582784.599311:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186217344:12345-0@lo:400:kworker.0 Request processed in 54us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582784.599338:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787582784.599377:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186217344:0@lo:400:kworker.0 00000100:00100000:0.0:1787582784.600809:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186217472:0@lo:400:kworker.0 00000100:00100000:0.0:1787582784.600873:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582784.601440:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582784.601451:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186217600:0@lo:400:kworker.0 00000100:00100000:0.0:1787582784.601511:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582784.601566:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186217600 00000100:00100000:0.0:1787582784.601576:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186217600 00000100:00100000:1.0:1787582784.602229:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186217216:0@lo:400:kworker.0 00000100:00080000:1.0:1787582784.602292:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582784.602337:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787582784.602352:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186217600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582784.602422:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186217600:12345-0@lo:400:kworker.0 Request processed in 75us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582784.602431:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787582784.602740:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186217600:0@lo:400:kworker.0 00000100:00100000:3.0:1787582784.603395:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186217472 00000100:00100000:3.0:1787582784.603406:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186217472 00000100:00100000:3.0:1787582784.604037:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787582784.604052:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186217472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582784.604145:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186217472:12345-0@lo:400:kworker.0 Request processed in 96us (3271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582784.604158:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1787582784.604283:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5ad9ad180 x1874416186217472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582784.604300:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186217472:0@lo:400:kworker.0 00000100:00100000:1.0:1787582784.604554:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186217728:0@lo:400:kworker.0 00000100:00100000:1.0:1787582784.604606:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582784.604633:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787582784.604639:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186217856:0@lo:400:kworker.0 00000100:00100000:1.0:1787582784.604666:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582784.604700:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186217856 00000100:00100000:1.0:1787582784.604707:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186217856 00000100:00100000:1.0:1787582784.604752:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787582784.604761:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186217856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582784.604821:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186217856:12345-0@lo:400:kworker.0 Request processed in 61us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582784.604839:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1787582784.604859:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787582784.604882:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5ad9af100 x1874416186217856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582784.604893:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186217856:0@lo:400:kworker.0 00000100:00100000:0.0:1787582784.605966:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186217728 00000100:00100000:0.0:1787582784.605978:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186217728 00000100:00100000:0.0:1787582784.606086:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787582784.606096:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186217728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582784.606177:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186217728:12345-0@lo:400:kworker.0 Request processed in 83us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582784.606184:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1787582784.606248:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582784.606287:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186217728:0@lo:400:kworker.0 00010000:00010000:0.0:1787582784.976783:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582785.108202:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186217984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582785.108388:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582785.108594:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186217984 00000100:00100000:2.0:1787582785.108604:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186217984 00000100:00100000:2.0:1787582785.109554:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787582785.109569:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186217984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787582785.110707:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582785.111169:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186217984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1600us (2778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582785.111180:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787582785.111368:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5ad9ad880 x1874416186217984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582785.111394:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186217984:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787582786.000525:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582787.030871:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582788.050258:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787582788.481115:0:11626:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1787582788.586784:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582788.586837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582788.586861:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582788.586889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582788.586915:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162067840 00000100:00100000:0.0:1787582788.586925:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162067840 00000100:00100000:0.0:1787582788.586981:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162068096 00000100:00100000:0.0:1787582788.586986:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162068096 00000100:00100000:0.0:1787582788.587011:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 102 00000100:00100000:0.0:1787582788.587020:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:2360:x1874416162067840:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582788.587086:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:2360:x1874416162067840:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 67us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582788.587094:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 102 00000100:00100000:0.0:1787582788.587111:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 103 00000100:00100000:0.0:1787582788.587118:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83345526-3920-4b94-b598-4d9f74280322+5:2360:x1874416162068096:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582788.587143:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83345526-3920-4b94-b598-4d9f74280322+5:2360:x1874416162068096:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582788.587149:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 103 00000100:00080000:0.0:1787582788.587169:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582788.587291:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162067712 00000100:00100000:3.0:1787582788.587295:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162067712 00000100:00100000:3.0:1787582788.587354:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 250 00000100:00100000:3.0:1787582788.587362:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162067712:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582788.587389:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162067712:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 29us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582788.587396:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 250 00000100:00100000:2.0:1787582788.592600:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162067968 00000100:00100000:2.0:1787582788.592613:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162067968 00000100:00100000:2.0:1787582788.592681:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 58 00000100:00100000:2.0:1787582788.592692:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf87a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2360:x1874416162067968:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582788.592760:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf87a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2360:x1874416162067968:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 70us (5922us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582788.592767:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 58 00000100:00080000:2.0:1787582788.592924:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787582788.690975:0:6722:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329697655167ns, next at 330697653070ns, rc = 0 00000100:00100000:1.0:1787582788.690996:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582788.691014:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186218112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582788.691070:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582788.691126:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186218112 00000100:00100000:1.0:1787582788.691133:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186218112 00000100:00100000:1.0:1787582788.691177:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787582788.691186:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186218112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787582788.691214:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582788.691250:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186218112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582788.691256:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1787582788.691275:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787582788.691300:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5855c3100 x1874416186218112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582788.691335:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186218112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787582789.073147:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787582789.278777:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1787582789.278804:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:3.0:1787582789.278824:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787582789.278981:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186218240:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787582789.279077:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582789.279342:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186218240 00000100:00100000:1.0:1787582789.279360:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186218240 00000100:00100000:1.0:1787582789.279502:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787582789.279513:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186218240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787582789.279545:0:6703:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1787582789.279587:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8c5940, atime: 0x6a8c5940, ctime: 0x6a8c5940, blocks: 0x1 00010000:00010000:1.0:1787582789.279596:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7537e5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.279614:0:6703:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:1.0:1787582789.279619:0:6703:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582789.279626:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7537e5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.279647:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7537e5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.279658:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7537e5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.279667:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7537e5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.279694:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787582789.280124:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582789.280133:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7537e5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582789.280142:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6600 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582789.280146:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7537e5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582789.280156:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7537e5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582789.280177:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7537e5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582789.280185:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7537e5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582789.280206:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582789.280208:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582789.280209:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582789.283141:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874416186218240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3617us (4052us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787582789.283156:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000004:00080000:0.0:1787582789.283432:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8da5bb682680/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787582789.283441:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186218240:0@lo:6:osp-syn-0-0.0 00000020:00000080:1.0:1787582789.632017:0:11678:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd92b48550 20000000:00000080:1.0:1787582789.632046:0:11678:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8da589c78c00 uarg=0000000000000000 20000000:01000000:1.0:1787582789.632093:0:11678:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787582789.632101:0:11678:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787582789.632108:0:11678:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787582789.633262:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787582789.636625:0:11678:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787582789.643036:0:11678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787582789.643104:0:11678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787582789.643154:0:11678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787582789.643172:0:11678:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787582789.643194:0:11678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8da5bb6b7800/0xa113d808b7537e66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.643217:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5a08d1600/0xa113d808b7537d01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f5b expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.643225:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5a08d0a00/0xa113d808b7537d08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f62 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.643234:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7537d16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537d0f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.643241:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537d24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537d1d expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.643248:0:11678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5a08d1e00/0xa113d808b7537d32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537d2b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.643255:0:11678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8da5bb6b7800/0xa113d808b7537e66 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.643302:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5a08d1e00/0xa113d808b7537d32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537d2b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.643465:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da5a08d1e00/0xa113d808b7537d32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537d2b expref: 18 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582789.643496:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1874416186218368:0@lo:104: 00000100:00100000:1.0:1787582789.643581:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787582789.643655:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537d1d expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.643664:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537d24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537d1d expref: 18 pid: 5848 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582789.643671:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1874416186218496:0@lo:104: 00000100:00100000:1.0:1787582789.643693:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787582789.643727:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7537d16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7537d0f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.643735:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7537d16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7537d0f expref: 18 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582789.643743:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1874416186218624:0@lo:104: 00010000:00010000:1.0:1787582789.643768:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5a08d0a00/0xa113d808b7537d08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f62 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.643778:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da5a08d0a00/0xa113d808b7537d08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f62 expref: 12 pid: 5848 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582789.643787:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf924000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1874416186218752:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582789.643833:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787582789.643857:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582789.643871:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186218368 00000100:00100000:3.0:1787582789.643880:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186218368 00000100:00100000:0.0:1787582789.643920:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186218496 00000100:00100000:0.0:1787582789.643927:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186218496 00000100:00100000:3.0:1787582789.643928:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186218624 00000100:00100000:3.0:1787582789.643941:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186218624 00000100:00100000:0.0:1787582789.643958:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787582789.643971:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+5:11678:x1874416186218368:12345-0@lo:104: 00010000:00010000:1.0:1787582789.643979:0:11678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5a08d1600/0xa113d808b7537d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f5b expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.643992:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7000/0xa113d808b7537d2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537d32 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.643995:0:11678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da5a08d1600/0xa113d808b7537d01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f5b expref: 12 pid: 5848 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582789.644004:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf927480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1874416186218880:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582789.644241:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787582789.644249:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+5:11678:x1874416186218368:12345-0@lo:104: Request processed in 281us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582789.644256:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787582789.644276:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787582789.644282:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb4fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+4:11678:x1874416186218496:12345-0@lo:104: 00010000:00010000:0.0:1787582789.644290:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1400/0xa113d808b7537d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537d24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644355:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787582789.644360:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb4fd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+4:11678:x1874416186218496:12345-0@lo:104: Request processed in 79us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582789.644366:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787582789.644404:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787582789.644411:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb683b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:11678:x1874416186218624:12345-0@lo:104: 00010000:00010000:0.0:1787582789.644420:0:5836:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0000/0xa113d808b7537d0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537d16 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644454:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787582789.644459:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb683b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+3:11678:x1874416186218624:12345-0@lo:104: Request processed in 49us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582789.644464:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1787582789.644495:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787582789.644503:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7000/0xa113d808b7537d2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537d32 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644517:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7000 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582789.644522:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7000/0xa113d808b7537d2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537d32 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644531:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7000/0xa113d808b7537d2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537d32 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582789.644538:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7000/0xa113d808b7537d2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537d32 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582789.644543:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787582789.644581:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7000/0xa113d808b7537d2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537d32 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644587:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582789.644612:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7000/0xa113d808b7537d2b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537d32 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644618:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7000/0xa113d808b7537d2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537d32 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644630:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787582789.644633:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1400/0xa113d808b7537d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537d24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644639:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1400 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582789.644642:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1400/0xa113d808b7537d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537d24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644658:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1400/0xa113d808b7537d1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537d24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582789.644664:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1400/0xa113d808b7537d1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537d24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582789.644669:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787582789.644682:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1400/0xa113d808b7537d1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537d24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644688:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582789.644704:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1400/0xa113d808b7537d1d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537d24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644711:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1400/0xa113d808b7537d1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537d24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644719:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582789.644722:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0000/0xa113d808b7537d0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7537d16 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644726:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0000 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582789.644729:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0000/0xa113d808b7537d0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7537d16 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644735:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0000/0xa113d808b7537d0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7537d16 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582789.644740:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0000/0xa113d808b7537d0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7537d16 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582789.644751:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787582789.644765:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0000/0xa113d808b7537d0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537d16 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644771:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582789.644777:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0000/0xa113d808b7537d0f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537d16 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644784:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0000/0xa113d808b7537d0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7537d16 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.644798:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582789.644799:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582789.644802:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582789.644808:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582789.644823:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186219008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787582789.644856:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582789.645487:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b5034d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787582789.645520:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1874416186218368:0@lo:104: 00000100:00100000:1.0:1787582789.645531:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1874416186218496:0@lo:104: 00000100:00100000:1.0:1787582789.645538:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1874416186218624:0@lo:104: 00000100:00100000:1.0:1787582789.646530:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186219264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787582789.646589:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582789.646701:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186219008 00000100:00100000:2.0:1787582789.646711:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186219008 00010000:00010000:2.0:1787582789.646752:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5a08d1e00/0xa113d808b7537d32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537d2b expref: 19 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582789.646839:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186219264 00000100:00100000:2.0:1787582789.646853:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186219264 00010000:00010000:2.0:1787582789.646869:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7537d16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537d0f expref: 20 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582789.646903:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787582789.646916:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+20:3312:x1874416186219008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787582789.646924:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582789.646931:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582789.646938:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5a08d1e00/0xa113d808b7537d32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537d2b expref: 20 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.646952:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5a08d1e00/0xa113d808b7537d32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537d2b expref: 20 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.646970:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5a08d1e00/0xa113d808b7537d32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537d2b expref: 20 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.646986:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582789.647025:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186219008:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (2168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582789.647032:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787582789.647058:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787582789.647064:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf926d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+18:3314:x1874416186219264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787582789.647072:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582789.647077:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7537d16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537d0f expref: 18 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.647085:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7537d16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537d0f expref: 18 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.647095:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7537d16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537d0f expref: 18 pid: 5846 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.647103:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582789.647137:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf926d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:3314:x1874416186219264:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582789.647143:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787582789.647192:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186219136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787582789.647230:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582789.647265:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186219136 00000100:00100000:0.0:1787582789.647269:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186219136 00010000:00010000:0.0:1787582789.647285:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537d24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537d1d expref: 17 pid: 5848 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582789.647298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582789.647303:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162068224 00000100:00100000:0.0:1787582789.647306:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162068224 00010000:00010000:0.0:1787582789.647337:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5a08d0a00/0xa113d808b7537d08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f62 expref: 13 pid: 5848 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582789.647364:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787582789.647369:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5911aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+17:3313:x1874416186219136:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787582789.647371:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186219008:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787582789.647377:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582789.647381:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537d24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7537d1d expref: 17 pid: 5848 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582789.647392:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7537d1d expref: 17 pid: 5848 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582789.647399:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 33 00010000:00010000:0.0:1787582789.647402:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4e9d600/0xa113d808b7537d24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7537d1d expref: 17 pid: 5848 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582789.647405:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162068224:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787582789.647412:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787582789.647413:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582789.647418:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5a08d0a00/0xa113d808b7537d08 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f62 expref: 13 pid: 5848 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582789.647427:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5a08d0a00/0xa113d808b7537d08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f62 expref: 13 pid: 5848 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582789.647437:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5911aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:3313:x1874416186219136:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (208us total) trans 0 rc 0/0 00010000:00010000:2.0:1787582789.647438:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582789.647444:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787582789.647491:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162068224:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 86us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582789.647498:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 33 00000100:00100000:0.0:1787582789.647512:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186219136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787582789.647583:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186219264:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787582789.647875:0:11678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5a08d0a00/0xa113d808b7537d08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f62 expref: 12 pid: 5848 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582789.647887:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf924000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1874416186218752:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582789.651611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582789.651719:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf927480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11678:1874416186218880:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582789.651763:0:11678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8da5bb6b7800/0xa113d808b7537e66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582789.651861:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162068352 00000100:00100000:2.0:1787582789.651871:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162068352 00010000:00010000:2.0:1787582789.651915:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5a08d1600/0xa113d808b7537d01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f5b expref: 12 pid: 5848 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582789.651956:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 34 00000100:00100000:2.0:1787582789.651967:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:2359:x1874416162068352:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582789.651984:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582789.651991:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5a08d1600/0xa113d808b7537d01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f5b expref: 12 pid: 5848 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582789.652019:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5a08d1600/0xa113d808b7537d01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f5b expref: 12 pid: 5848 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582789.652040:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5a08d1600/0xa113d808b7537d01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f5b expref: 12 pid: 5848 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582789.652061:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8da5bb6b7800/0xa113d808b7537e66 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582789.652070:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5bb6b7800/0xa113d808b7537e66 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582789.652088:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5bb6b7800/0xa113d808b7537e66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582789.652096:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5bb6b7800/0xa113d808b7537e66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582789.652104:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8da5bb6b7800/0xa113d808b7537e66 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582789.652111:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8da5bb6b7800/0xa113d808b7537e66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582789.652117:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7800 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582789.652122:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8da5bb6b7800/0xa113d808b7537e66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582789.652131:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8da5bb6b7800/0xa113d808b7537e66 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582789.652167:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8da5bb6b7800/0xa113d808b7537e66 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582789.652177:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582789.652250:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:2359:x1874416162068352:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 284us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582789.652259:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 34 00010000:00010000:1.0:1787582789.652503:0:11678:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8da5bb6b7800/0xa113d808b7537e66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.652512:0:11678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8da5bb6b7800/0xa113d808b7537e66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582789.652531:0:11678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5bb6b7800/0xa113d808b7537e66 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582789.714159:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186219648:0@lo:400:kworker.0 00000100:00100000:2.0:1787582789.714193:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186219520:0@lo:400:kworker.0 00000100:00100000:1.0:1787582789.714271:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186219392:0@lo:400:kworker.0 00000100:00100000:0.0:1787582789.715425:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186219776:0@lo:400:kworker.0 00000100:00100000:2.0:1787582789.719555:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582789.719672:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186219520 00000100:00100000:2.0:1787582789.719683:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186219520 00000100:00100000:2.0:1787582789.719747:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787582789.719759:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186219520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582789.719824:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186219520:12345-0@lo:400:kworker.0 Request processed in 69us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582789.719832:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1787582789.719851:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787582789.719891:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186219520:0@lo:400:kworker.0 00000100:00100000:1.0:1787582789.720344:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582789.720482:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582789.720595:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186219392 00000100:00100000:1.0:1787582789.720601:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186219392 00000100:00100000:1.0:1787582789.720639:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186219648 00000100:00100000:1.0:1787582789.720642:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186219648 00000100:00100000:1.0:1787582789.720666:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787582789.720673:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186219392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582789.720723:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186219392:12345-0@lo:400:kworker.0 Request processed in 50us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582789.720731:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787582789.720745:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787582789.720751:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186219648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582789.720783:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186219648:12345-0@lo:400:kworker.0 Request processed in 32us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582789.720789:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787582789.720831:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186219392:0@lo:400:kworker.0 00000100:00100000:1.0:1787582789.720857:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588495500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186219648:0@lo:400:kworker.0 00000100:00100000:0.0:1787582789.721353:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787582789.721361:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582789.721519:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186219776 00000100:00100000:1.0:1787582789.721526:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186219776 00000100:00100000:1.0:1787582789.721571:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787582789.721578:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186219776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582789.721639:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186219776:12345-0@lo:400:kworker.0 Request processed in 61us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582789.721646:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1787582789.721696:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787582789.721724:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da588494e00 x1874416186219776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582789.721738:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588494e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186219776:0@lo:400:kworker.0 00010000:00010000:0.0:1787582790.096643:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582790.224564:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186219904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787582790.224674:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582790.225547:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186219904 00000100:00100000:2.0:1787582790.225560:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186219904 00000100:00100000:1.0:1787582790.225711:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787582790.225724:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186219904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787582790.225766:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582790.225841:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186219904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582790.225850:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1787582790.225917:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5ad9af480 x1874416186219904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582790.225939:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186219904:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1787582790.800504:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787582790.800515:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da5bb7f0800 from 7 10000000:01000000:2.0:1787582790.800522:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787582790.800598:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582790.800611:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582790.800720:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582790.800752:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186220032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787582790.800902:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582790.801071:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bb6a9540 going to sleep for 11 seconds 00000100:00100000:0.0:1787582790.802909:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186220032 00000100:00100000:0.0:1787582790.802921:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186220032 00000100:00100000:0.0:1787582790.803271:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1787582790.803282:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+16:5851:x1874416186220032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787582790.803298:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582790.803344:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da580031800/0xa113d808b7537e74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537e6d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582790.803373:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da580031800/0xa113d808b7537e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537e6d expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582790.803384:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da580031800/0xa113d808b7537e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537e6d expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582790.803393:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580031800, rc 0) 00000100:00100000:0.0:1787582790.803475:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186220032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (2566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582790.803483:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787582790.803771:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186220032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582790.803791:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537e74 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582790.803800:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537e74 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582790.803866:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186220160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582790.803903:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582790.804062:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bb6a9540 going to sleep for 11 seconds 00000100:00100000:3.0:1787582790.804147:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186220160 00000100:00100000:3.0:1787582790.804152:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186220160 00000100:00100000:3.0:1787582790.804179:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787582790.804185:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186220160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582790.804506:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186220160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582790.804514:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787582790.804684:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186220160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582790.804715:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186220288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582790.804754:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582790.804783:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bb6a9540 going to sleep for 11 seconds 00000100:00100000:3.0:1787582790.804835:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186220288 00000100:00100000:3.0:1787582790.804839:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186220288 00000100:00100000:3.0:1787582790.804857:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787582790.804863:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186220288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582790.804994:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186220288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582790.805000:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787582790.805389:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186220288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582790.805764:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:11691:1874416186220416:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582790.805807:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582790.806715:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bb6a9000 going to sleep for 11 seconds 00000100:00100000:1.0:1787582790.806798:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186220416 00000100:00100000:1.0:1787582790.806805:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186220416 00000100:00100000:1.0:1787582790.806851:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787582790.806860:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:11691:x1874416186220416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582790.807059:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589d79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:11691:x1874416186220416:12345-0@lo:502:llog_process_th.0 Request processed in 198us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582790.807066:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787582790.807194:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:11691:1874416186220416:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787582790.807232:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582790.807242:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582790.807244:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787582790.807252:0:11691:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8da5bb7f0800 00000020:00000080:2.0:1787582790.807254:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787582790.807341:0:11691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:11691:1874416186220544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582790.807380:0:11691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582790.807392:0:11691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bb6a9000 going to sleep for 11 seconds 00000100:00100000:1.0:1787582790.807589:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186220544 00000100:00100000:1.0:1787582790.807594:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186220544 00000100:00100000:1.0:1787582790.807615:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787582790.807621:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:11691:x1874416186220544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582790.807743:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589d78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:11691:x1874416186220544:12345-0@lo:502:llog_process_th.0 Request processed in 121us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582790.807757:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787582790.807841:0:11691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:11691:1874416186220544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787582790.807860:0:11691:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582790.807865:0:11691:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582790.807867:0:11691:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787582790.807871:0:11691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787582790.811487:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787582790.811520:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787582790.811531:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537e74 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582790.811545:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537e74 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582790.811556:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787582790.811558:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da5a1567000 from 7 10000000:01000000:1.0:1787582790.811561:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787582790.811593:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582790.811602:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582790.811614:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582790.811637:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf924000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186220672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787582790.811695:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582790.811745:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b5034a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582790.811813:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186220672 00000100:00100000:2.0:1787582790.811821:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186220672 00000100:00100000:2.0:1787582790.811869:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787582790.811879:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+17:5851:x1874416186220672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582790.811892:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582790.811904:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4e9d400/0xa113d808b7537e82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537e7b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582790.811935:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4e9d400/0xa113d808b7537e82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537e7b expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582790.811945:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4e9d400/0xa113d808b7537e82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537e7b expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582790.811954:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9d400, rc 0) 00000100:00100000:2.0:1787582790.812001:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186220672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582790.812007:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787582790.812091:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf924000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186220672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582790.812116:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582790.812125:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582790.812177:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf924000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186220800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582790.812201:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582790.812422:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b5034a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582790.812474:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186220800 00000100:00100000:2.0:1787582790.812478:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186220800 00000100:00100000:2.0:1787582790.812507:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787582790.812513:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186220800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582790.812723:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186220800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 210us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582790.812730:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787582790.812984:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf924000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186220800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582790.813011:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf924000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186220928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582790.813050:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582790.813079:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b5034a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582790.813184:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186220928 00000100:00100000:2.0:1787582790.813189:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186220928 00000100:00100000:2.0:1787582790.813228:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787582790.813235:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186220928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582790.813390:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186220928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582790.813397:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787582790.813560:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf924000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186220928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582790.813868:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf924000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:11693:1874416186221056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582790.813905:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582790.813936:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b5034b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582790.813982:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186221056 00000100:00100000:2.0:1787582790.813986:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186221056 00000100:00100000:2.0:1787582790.814016:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787582790.814023:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:11693:x1874416186221056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582790.814162:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:11693:x1874416186221056:12345-0@lo:502:llog_process_th.0 Request processed in 139us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582790.814169:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787582790.816733:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf924000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:11693:1874416186221056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787582790.816786:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582790.816800:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582790.816803:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787582790.816812:0:11693:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8da5a1567000 00000020:00000080:1.0:1787582790.816816:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787582790.816912:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf924000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:11693:1874416186221184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582790.816984:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582790.817017:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b5034b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582790.817376:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186221184 00000100:00100000:2.0:1787582790.817383:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186221184 00000100:00100000:2.0:1787582790.817425:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787582790.817440:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:11693:x1874416186221184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582790.817659:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:11693:x1874416186221184:12345-0@lo:502:llog_process_th.0 Request processed in 219us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582790.817666:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787582790.817975:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf924000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:11693:1874416186221184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787582790.817998:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582790.818004:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582790.818011:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787582790.818016:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787582790.832812:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787582790.832843:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787582790.832854:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582790.832867:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582790.832878:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787582790.832881:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da584c3b800 from 7 10000000:01000000:2.0:1787582790.832883:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787582790.832920:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582790.832929:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582790.832939:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582790.832962:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186221312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787582790.833023:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582790.833139:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bb6a96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582790.842093:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186221312 00000100:00100000:3.0:1787582790.842229:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186221312 00000100:00100000:3.0:1787582790.842297:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787582790.842309:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589263c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+18:5851:x1874416186221312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582790.842459:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582790.842487:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5a08d1a00/0xa113d808b7537e90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7537e89 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582790.842532:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5a08d1a00/0xa113d808b7537e90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7537e89 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582790.842543:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5a08d1a00/0xa113d808b7537e90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7537e89 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582790.842552:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1a00, rc 0) 00000100:00100000:3.0:1787582790.842631:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589263c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186221312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 324us (9607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582790.842637:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1787582790.842726:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186221312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582790.842743:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537e90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582790.842753:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537e90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582790.842818:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf924000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186221440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582790.842850:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582790.842883:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b5034b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787582790.842931:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186221440 00000100:00100000:3.0:1787582790.842935:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186221440 00000100:00100000:3.0:1787582790.842990:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787582790.842997:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186221440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582790.843226:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186221440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582790.843232:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787582790.843292:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf924000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186221440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582790.843345:0:5851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb684a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186221568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582790.843385:0:5851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1787582790.854520:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787582790.856561:0:5851:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5ab930d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787582790.859462:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186221568 00000100:00100000:1.0:1787582790.859486:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186221568 00000100:00100000:1.0:1787582790.859543:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787582790.859553:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186221568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582790.859775:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:5851:x1874416186221568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (16388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582790.859783:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787582790.860567:0:5851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb684a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:615b3d9a-8a7c-4227-a987-f23a2209c536:5851:1874416186221568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582790.877678:0:11696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf924a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:11696:1874416186221696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582790.877753:0:11696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582790.877790:0:11696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b5034300 going to sleep for 11 seconds 00000100:00100000:1.0:1787582790.877812:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186221696 00000100:00100000:1.0:1787582790.877818:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186221696 00000100:00100000:1.0:1787582790.877858:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787582790.877867:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589263050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:11696:x1874416186221696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582790.878053:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589263050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:11696:x1874416186221696:12345-0@lo:502:llog_process_th.0 Request processed in 187us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582790.878067:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787582790.878113:0:11696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf924a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:11696:1874416186221696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787582790.878139:0:11696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582790.878148:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582790.878150:0:11696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787582790.878159:0:11696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8da584c3b800 00000020:00000080:1.0:1787582790.878161:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787582790.878223:0:11696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf924a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:11696:1874416186221824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582790.878255:0:11696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582790.878268:0:11696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b5034300 going to sleep for 11 seconds 00000100:00100000:1.0:1787582790.878498:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186221824 00000100:00100000:1.0:1787582790.878502:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186221824 00000100:00100000:1.0:1787582790.878528:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787582790.878535:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:11696:x1874416186221824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582790.878647:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:11696:x1874416186221824:12345-0@lo:502:llog_process_th.0 Request processed in 112us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582790.878654:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1787582790.878689:0:11696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf924a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:615b3d9a-8a7c-4227-a987-f23a2209c536:11696:1874416186221824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787582790.878708:0:11696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582790.878712:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582790.878713:0:11696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787582790.878718:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787582790.878824:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787582790.878839:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787582790.878848:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537e90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582790.878869:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537e90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582791.120561:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582791.698845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582791.699061:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162068480 00000100:00100000:1.0:1787582791.699071:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162068480 00000100:00100000:1.0:1787582791.699159:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 266 00000100:00100000:1.0:1787582791.699169:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:5599:x1874416162068480:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582791.699184:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582791.699198:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7537e97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57faf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582791.699223:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7537e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57faf expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582791.699234:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7537e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57faf expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582791.699242:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6400, rc 0) 00000100:00100000:1.0:1787582791.699303:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:5599:x1874416162068480:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 Request processed in 135us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582791.699311:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 266 00000100:00100000:3.0:1787582791.701800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582791.702664:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162068608 00000100:00100000:2.0:1787582791.702696:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162068608 00000100:00100000:2.0:1787582791.702768:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 267 00000100:00100000:2.0:1787582791.702779:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:5599:x1874416162068608:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582791.703085:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:5599:x1874416162068608:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 Request processed in 306us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582791.703094:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 267 00000100:00100000:0.0:1787582791.708048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582791.718607:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162068736 00000100:00100000:1.0:1787582791.718629:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162068736 00000100:00100000:1.0:1787582791.721499:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 268 00000100:00100000:1.0:1787582791.721535:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:5599:x1874416162068736:12345-192.168.206.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582791.722019:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:5599:x1874416162068736:12345-192.168.206.20@tcp:503:ll_cfg_requeue.0 Request processed in 502us (13981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582791.722038:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 268 00000100:00100000:3.0:1787582791.728921:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582791.729373:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162068864 00000100:00100000:1.0:1787582791.729981:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162068864 00000100:00100000:1.0:1787582791.730132:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 269 00000100:00100000:1.0:1787582791.730152:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:9965:x1874416162068864:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787582791.730525:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:9965:x1874416162068864:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 381us (1820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582791.730534:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 269 00000100:00100000:3.0:1787582791.737975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582791.742958:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162068992 00000100:00100000:2.0:1787582791.742981:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162068992 00000100:00100000:2.0:1787582791.743074:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 270 00000100:00100000:2.0:1787582791.743088:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:9965:x1874416162068992:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787582791.743620:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:9965:x1874416162068992:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 531us (5657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582791.743630:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 270 00000100:00100000:0.0:1787582791.757560:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582791.757734:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162069120 00000100:00100000:2.0:1787582791.757748:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162069120 00000100:00100000:2.0:1787582791.757817:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 271 00000100:00100000:2.0:1787582791.757829:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:5599:x1874416162069120:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582791.757851:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582791.757881:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4e9d800/0xa113d808b7537e9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57fb6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582791.757919:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4e9d800/0xa113d808b7537e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fb6 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582791.757931:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4e9d800/0xa113d808b7537e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fb6 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582791.757966:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9d800, rc 0) 00000100:00100000:2.0:1787582791.758618:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:5599:x1874416162069120:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 Request processed in 787us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582791.758628:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 271 00000100:00100000:3.0:1787582791.763005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582791.763300:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162069248 00000100:00100000:0.0:1787582791.763312:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162069248 00000100:00100000:0.0:1787582791.763397:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 272 00000100:00100000:0.0:1787582791.763410:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:5599:x1874416162069248:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582791.769686:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:5599:x1874416162069248:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 Request processed in 6261us (6673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582791.769712:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 272 00000100:00100000:0.0:1787582791.776764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582791.777080:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162069376 00000100:00100000:3.0:1787582791.777093:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162069376 00000100:00100000:3.0:1787582791.777169:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 273 00000100:00100000:3.0:1787582791.777181:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:5599:x1874416162069376:12345-192.168.206.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582791.778069:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:5599:x1874416162069376:12345-192.168.206.20@tcp:503:ll_cfg_requeue.0 Request processed in 883us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582791.778081:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 273 00000100:00100000:2.0:1787582791.782050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582791.782456:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162069504 00000100:00100000:0.0:1787582791.782483:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162069504 00000100:00100000:0.0:1787582791.782558:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 274 00000100:00100000:0.0:1787582791.782570:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:9968:x1874416162069504:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787582791.783101:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:9968:x1874416162069504:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 530us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582791.783110:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 274 00000100:00100000:2.0:1787582791.797971:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582791.798119:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162069632 00000100:00100000:3.0:1787582791.798142:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162069632 00000100:00100000:3.0:1787582791.798211:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 275 00000100:00100000:3.0:1787582791.798223:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:9968:x1874416162069632:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787582791.798597:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:9968:x1874416162069632:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 374us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582791.798607:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 275 00000040:00080000:0.0:1787582791.889427:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787582792.146471:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582793.169400:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582793.682900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582793.682943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582793.682974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582793.682999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582793.683173:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162070016 00000100:00100000:0.0:1787582793.683195:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162070016 00000100:00100000:3.0:1787582793.683265:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162069888 00000100:00100000:3.0:1787582793.683276:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162069888 00000100:00100000:0.0:1787582793.683313:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 60 00000100:00100000:3.0:1787582793.683370:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162070144 00000100:00100000:3.0:1787582793.683374:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162070144 00000100:00100000:3.0:1787582793.683404:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 107 00000100:00100000:0.0:1787582793.683413:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2360:x1874416162070016:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582793.683425:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2360:x1874416162069888:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582793.683515:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2360:x1874416162069888:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 98us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582793.683524:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 107 00000100:00100000:3.0:1787582793.683541:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 108 00000100:00100000:0.0:1787582793.683548:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2360:x1874416162070016:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 146us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582793.683559:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83345526-3920-4b94-b598-4d9f74280322+5:2360:x1874416162070144:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582793.683570:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 60 00000100:00100000:3.0:1787582793.683601:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83345526-3920-4b94-b598-4d9f74280322+5:2360:x1874416162070144:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 50us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582793.683613:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 108 00000100:00100000:0.0:1787582793.683614:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162069760 00000100:00100000:0.0:1787582793.683634:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162069760 00000100:00100000:0.0:1787582793.683679:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 276 00000100:00100000:0.0:1787582793.683688:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162069760:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582793.683730:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162069760:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 41us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582793.683738:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 276 00000100:00080000:2.0:1787582793.684221:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787582793.684227:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787582793.808655:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186221952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787582793.808761:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582793.808982:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186221952 00000100:00100000:3.0:1787582793.808994:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186221952 00000100:00080000:1.0:1787582793.809050:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582793.809071:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787582793.809081:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874416186221952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787582793.809126:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582793.817293:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874416186221952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4302us (4622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582793.817751:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787582793.817860:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf924a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186221952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787582794.192639:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787582794.395965:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:1.0:1787582794.833082:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186222080:0@lo:400:kworker.0 00000100:00100000:1.0:1787582794.833183:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582794.833430:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186222080 00000100:00100000:3.0:1787582794.833452:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186222080 00000100:00100000:3.0:1787582794.833513:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1787582794.833525:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3313:x1874416186222080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582794.833594:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3313:x1874416186222080:12345-0@lo:400:kworker.0 Request processed in 72us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582794.833602:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1787582794.833896:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186222080:0@lo:400:kworker.0 00000100:00100000:0.0:1787582794.834190:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186222336:0@lo:400:kworker.0 00000100:00100000:0.0:1787582794.834232:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582794.834261:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787582794.834267:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da589c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186222464:0@lo:400:kworker.0 00000100:00100000:0.0:1787582794.834295:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582794.834343:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186222336 00000100:00100000:0.0:1787582794.834348:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186222336 00000100:00100000:0.0:1787582794.834384:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787582794.834391:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186222336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582794.834496:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186222592:0@lo:400:kworker.0 00000100:00100000:1.0:1787582794.834525:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582794.834545:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787582794.834550:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186222208:0@lo:400:kworker.0 00000100:00100000:1.0:1787582794.834571:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582794.834586:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186222720:0@lo:400:kworker.0 00000100:00100000:1.0:1787582794.834607:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582794.834649:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186222720 00000100:00100000:1.0:1787582794.834652:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186222720 00000100:00100000:1.0:1787582794.834688:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787582794.834695:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186222720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582794.834748:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186222720:12345-0@lo:400:kworker.0 Request processed in 53us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582794.834773:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1787582794.834802:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787582794.834832:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5855c0a80 x1874416186222720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582794.834847:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186222720:0@lo:400:kworker.0 00000100:00100000:0.0:1787582794.835296:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186222336:12345-0@lo:400:kworker.0 Request processed in 901us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582794.835305:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787582794.835428:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186222464 00000100:00100000:3.0:1787582794.835434:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186222464 00000100:00100000:3.0:1787582794.835495:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186222592 00000100:00100000:3.0:1787582794.835499:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186222592 00000100:00100000:3.0:1787582794.835513:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186222208 00000100:00100000:3.0:1787582794.835515:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186222208 00000100:00100000:3.0:1787582794.835529:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787582794.835536:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186222464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582794.835576:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186222464:12345-0@lo:400:kworker.0 Request processed in 41us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582794.835582:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787582794.835593:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787582794.835598:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186222592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582794.835644:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186222592:12345-0@lo:400:kworker.0 Request processed in 45us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582794.835650:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787582794.835661:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787582794.835668:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186222208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582794.835706:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186222208:12345-0@lo:400:kworker.0 Request processed in 28us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582794.835712:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787582794.835756:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186222208:0@lo:400:kworker.0 00000100:00100000:3.0:1787582794.835768:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186222592:0@lo:400:kworker.0 00000100:00080000:0.0:1787582794.836056:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582794.836156:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da589c7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186222464:0@lo:400:kworker.0 00000100:00100000:1.0:1787582794.836169:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787582794.836175:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8da5bb682680, transno 4294967300 00000100:00100000:1.0:1787582794.836194:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186222336:0@lo:400:kworker.0 00010000:00010000:3.0:1787582795.216605:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582795.345796:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186222848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582795.345907:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582795.346233:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186222848 00000100:00100000:2.0:1787582795.346244:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186222848 00000100:00100000:2.0:1787582795.346312:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787582795.346354:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186222848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787582795.346397:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582795.346526:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186222848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582795.346535:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1787582795.354190:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5ad9ad180 x1874416186222848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582795.354226:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186222848:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787582796.242252:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582797.264773:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582798.288537:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582798.806396:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582798.806451:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582798.806497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582798.806524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582798.806553:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162070400 00000100:00100000:2.0:1787582798.806562:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162070400 00000100:00100000:2.0:1787582798.806611:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162070656 00000100:00100000:2.0:1787582798.806614:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162070656 00000100:00100000:2.0:1787582798.806636:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 112 00000100:00100000:2.0:1787582798.806644:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162070400:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582798.806713:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162070400:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582798.806721:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 112 00000100:00100000:2.0:1787582798.806736:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 113 00000100:00100000:2.0:1787582798.806742:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+5:2358:x1874416162070656:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582798.806766:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+5:2358:x1874416162070656:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 24us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582798.806772:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 113 00000100:00080000:2.0:1787582798.806787:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582798.807122:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162070528 00000100:00100000:1.0:1787582798.807127:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162070528 00000100:00100000:1.0:1787582798.807168:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 63 00000100:00100000:1.0:1787582798.807175:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162070528:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582798.807207:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162070528:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 34us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582798.807213:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 63 00000100:00100000:0.0:1787582798.807545:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162070272 00000100:00100000:0.0:1787582798.807550:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162070272 00000100:00100000:0.0:1787582798.807582:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 278 00000100:00100000:0.0:1787582798.807589:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2358:x1874416162070272:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582798.807632:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2358:x1874416162070272:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 43us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582798.807638:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 278 00000100:00080000:2.0:1787582798.808164:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582798.929155:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186222976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787582798.929224:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582798.929365:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186222976 00000100:00100000:2.0:1787582798.929373:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186222976 00000100:00100000:2.0:1787582798.929446:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787582798.929455:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186222976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582798.929489:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582798.929536:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186222976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582798.929543:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787582798.929582:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186222976:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787582798.929655:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787582799.314042:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582799.952647:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186223104:0@lo:400:kworker.0 00000100:00100000:3.0:1787582799.952715:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582799.952818:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186223104 00000100:00100000:0.0:1787582799.952826:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186223104 00000100:00100000:0.0:1787582799.952873:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787582799.952882:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3313:x1874416186223104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582799.953059:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186223232:0@lo:400:kworker.0 00000100:00100000:1.0:1787582799.953092:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582799.953142:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186223232 00000100:00100000:1.0:1787582799.953146:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186223232 00000100:00100000:1.0:1787582799.953175:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787582799.953182:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186223232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582799.953232:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186223232:12345-0@lo:400:kworker.0 Request processed in 50us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582799.953258:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787582799.953298:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186223232:0@lo:400:kworker.0 00000100:00100000:1.0:1787582799.957147:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186223360:0@lo:400:kworker.0 00000100:00100000:0.0:1787582799.957362:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3313:x1874416186223104:12345-0@lo:400:kworker.0 Request processed in 4478us (4643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582799.957373:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787582799.957388:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186223104:0@lo:400:kworker.0 00000100:00100000:1.0:1787582799.957478:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582799.958102:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186223488:0@lo:400:kworker.0 00000100:00100000:0.0:1787582799.958219:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582799.958290:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186223488 00000100:00100000:0.0:1787582799.958296:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186223488 00000100:00100000:0.0:1787582799.958360:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787582799.958369:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186223488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582799.958506:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186223488:12345-0@lo:400:kworker.0 Request processed in 138us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582799.958512:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1787582799.958530:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582799.958553:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186223488:0@lo:400:kworker.0 00000100:00100000:3.0:1787582799.958659:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186223360 00000100:00100000:3.0:1787582799.958663:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186223360 00000100:00100000:3.0:1787582799.958699:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787582799.958705:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186223360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582799.960038:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186223616:0@lo:400:kworker.0 00000100:00100000:0.0:1787582799.960085:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582799.960130:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582799.960136:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186223744:0@lo:400:kworker.0 00000100:00100000:0.0:1787582799.960160:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582799.960206:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186223744 00000100:00100000:0.0:1787582799.960213:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186223744 00000100:00100000:0.0:1787582799.960254:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787582799.960261:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186223744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582799.960302:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186223744:12345-0@lo:400:kworker.0 Request processed in 41us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582799.960309:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787582799.960346:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787582799.960368:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb682680 x1874416186223744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582799.960381:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186223744:0@lo:400:kworker.0 00000100:00100000:2.0:1787582799.960590:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186223616 00000100:00100000:2.0:1787582799.960595:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186223616 00000100:00100000:2.0:1787582799.960639:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787582799.960647:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186223616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582799.960686:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186223616:12345-0@lo:400:kworker.0 Request processed in 40us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582799.960691:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1787582799.960756:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582799.960775:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186223616:0@lo:400:kworker.0 00000100:00100000:3.0:1787582799.968923:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186223360:12345-0@lo:400:kworker.0 Request processed in 10209us (11436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582799.968955:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787582799.971544:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186223360:0@lo:400:kworker.0 00010000:00010000:2.0:1787582800.340056:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582800.465989:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186223872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787582800.466055:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582800.466194:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186223872 00000100:00100000:2.0:1787582800.466202:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186223872 00000100:00100000:2.0:1787582800.466245:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787582800.466255:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186223872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787582800.466285:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582800.466998:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186223872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 742us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582800.467007:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1787582800.467678:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb681f80 x1874416186223872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582800.467700:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186223872:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787582801.105663:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787582801.362840:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582802.386571:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582803.408656:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582803.926258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582803.926308:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582803.926498:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162070784 00000100:00100000:0.0:1787582803.926508:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162070784 00000100:00100000:0.0:1787582803.926559:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 280 00000100:00100000:0.0:1787582803.926569:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2358:x1874416162070784:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582803.926635:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2358:x1874416162070784:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 67us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582803.926642:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 280 00000100:00100000:1.0:1787582803.927150:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162070912 00000100:00100000:1.0:1787582803.927155:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162070912 00000100:00100000:1.0:1787582803.927211:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 117 00000100:00100000:1.0:1787582803.927235:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162070912:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582803.927282:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162070912:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 48us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582803.927288:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 117 00000100:00080000:0.0:1787582803.927601:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582803.949538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582803.949583:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582803.949674:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162071168 00000100:00100000:2.0:1787582803.949683:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162071168 00000100:00100000:2.0:1787582803.949768:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 118 00000100:00100000:2.0:1787582803.949779:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162071168:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582803.949847:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162071168:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 70us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582803.949850:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162071040 00000100:00100000:2.0:1787582803.949854:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 118 00000100:00100000:0.0:1787582803.949854:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162071040 00000100:00100000:0.0:1787582803.949882:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:0.0:1787582803.949899:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2356:x1874416162071040:12345-192.168.206.20@tcp:9:kworker.0 00000020:00000080:0.0:1787582803.949917:0:8218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537dda 00000100:00080000:0.0:1787582803.949926:0:8218:0:(import.c:65:import_set_state_nolock()) ffff8da5bf278800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787582803.949968:0:8218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:3.0:1787582803.950015:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787582803.950019:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787582803.950305:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582803.950445:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+2:2356:x1874416162071040:12345-192.168.206.20@tcp:9:kworker.0 Request processed in 554us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582803.950452:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:0.0:1787582804.048566:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787582804.048589:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186224000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787582804.048657:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582804.048820:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186224000 00000100:00100000:1.0:1787582804.048828:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186224000 00000100:00100000:1.0:1787582804.048890:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787582804.048900:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186224000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787582804.048933:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582804.048983:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186224000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582804.048990:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787582804.049032:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186224000:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787582804.049194:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787582804.434349:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787582804.647793:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 730f9f4f-46d8-441e-9162-5fde1074d6a5 00000020:00000080:0.0:1787582804.647801:0:6733:0:(genops.c:885:class_export_put()) final put ffff8da5bf27c800/730f9f4f-46d8-441e-9162-5fde1074d6a5 00000020:00000080:3.0:1787582804.648092:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bf27c800/730f9f4f-46d8-441e-9162-5fde1074d6a5 for lustre-OST0000 00000020:00000080:3.0:1787582804.648141:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5bf278800 for lustre-OST0000 00000100:00100000:0.0:1787582805.073286:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186224128:0@lo:400:kworker.0 00000100:00100000:0.0:1787582805.073398:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582805.073580:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186224128 00000100:00100000:2.0:1787582805.073593:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186224128 00000100:00100000:2.0:1787582805.073655:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787582805.073664:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3313:x1874416186224128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582805.074646:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186224256:0@lo:400:kworker.0 00000100:00100000:3.0:1787582805.074687:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582805.074729:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186224256 00000100:00100000:3.0:1787582805.074733:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186224256 00000100:00100000:3.0:1787582805.074764:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787582805.074770:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186224256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582805.074805:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186224256:12345-0@lo:400:kworker.0 Request processed in 35us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582805.074812:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787582805.074842:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186224256:0@lo:400:kworker.0 00000100:00100000:1.0:1787582805.082315:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186224512:0@lo:400:kworker.0 00000100:00100000:1.0:1787582805.082427:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582805.082466:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582805.082472:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186224384:0@lo:400:kworker.0 00000100:00100000:1.0:1787582805.082499:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582805.082530:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186224512 00000100:00100000:1.0:1787582805.082537:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186224512 00000100:00100000:1.0:1787582805.082582:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787582805.082590:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186224512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582805.082648:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186224512:12345-0@lo:400:kworker.0 Request processed in 59us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582805.082655:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787582805.082674:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186224384 00000100:00100000:1.0:1787582805.082678:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186224384 00000100:00100000:1.0:1787582805.082698:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787582805.082704:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186224384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582805.082730:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186224384:12345-0@lo:400:kworker.0 Request processed in 27us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582805.082736:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787582805.082767:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186224384:0@lo:400:kworker.0 00000100:00100000:1.0:1787582805.082777:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186224512:0@lo:400:kworker.0 00000100:00100000:1.0:1787582805.082798:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186224768:0@lo:400:kworker.0 00000100:00100000:1.0:1787582805.082820:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582805.082838:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787582805.082843:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874416186224640:0@lo:400:kworker.0 00000100:00100000:1.0:1787582805.082861:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582805.082894:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186224768 00000100:00100000:1.0:1787582805.082898:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186224768 00000100:00100000:1.0:1787582805.082923:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787582805.082929:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186224768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582805.082967:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186224768:12345-0@lo:400:kworker.0 Request processed in 38us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582805.082973:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787582805.082989:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186224640 00000100:00100000:1.0:1787582805.082992:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186224640 00000100:00100000:1.0:1787582805.083017:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787582805.083024:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874416186224640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582805.083054:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874416186224640:12345-0@lo:400:kworker.0 Request processed in 31us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582805.083059:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787582805.083314:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874416186224640:0@lo:400:kworker.0 00010000:00080000:1.0:1787582805.083346:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5b4fa0e00 x1874416186224768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582805.083355:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186224768:0@lo:400:kworker.0 00000100:00080000:1.0:1787582805.083397:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787582805.083402:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787582805.088790:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3313:x1874416186224128:12345-0@lo:400:kworker.0 Request processed in 15118us (15392us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582805.088806:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787582805.089005:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186224128:0@lo:400:kworker.0 00010000:00010000:2.0:1787582805.456487:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582805.585293:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582805.585314:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186224896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582805.585396:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582805.585456:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186224896 00000100:00100000:1.0:1787582805.585463:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186224896 00000100:00100000:1.0:1787582805.585501:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787582805.585509:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186224896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787582805.585551:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582805.585591:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186224896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582805.585598:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787582805.585645:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5bb682300 x1874416186224896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582805.585663:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186224896:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787582806.480502:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582807.504852:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582808.528488:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582809.047666:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582809.047719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582809.047750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582809.048276:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162071424 00000100:00100000:0.0:1787582809.048287:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162071424 00000100:00100000:0.0:1787582809.048394:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162071552 00000100:00100000:0.0:1787582809.048398:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162071552 00000100:00100000:0.0:1787582809.048421:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 122 00000100:00100000:0.0:1787582809.048430:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162071424:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582809.048479:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162071296 00000100:00100000:2.0:1787582809.048484:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162071296 00000100:00100000:0.0:1787582809.048503:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162071424:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 72us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582809.048511:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 122 00000100:00100000:0.0:1787582809.048532:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 123 00000100:00100000:2.0:1787582809.048539:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 282 00000100:00100000:0.0:1787582809.048543:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83345526-3920-4b94-b598-4d9f74280322+5:2360:x1874416162071552:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582809.048553:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162071296:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582809.048574:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83345526-3920-4b94-b598-4d9f74280322+5:2360:x1874416162071552:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 34us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582809.048582:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 123 00000100:00100000:2.0:1787582809.048592:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162071296:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 41us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582809.048602:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 282 00000100:00080000:3.0:1787582809.049003:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582809.172872:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186225024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582809.172954:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582809.174207:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186225024 00000100:00100000:3.0:1787582809.174219:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186225024 00000100:00080000:1.0:1787582809.174286:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582809.174303:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787582809.174314:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186225024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787582809.174376:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582809.174439:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186225024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582809.174446:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787582809.174614:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186225024:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787582809.552456:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582810.193603:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186225408:0@lo:400:kworker.0 00000100:00100000:0.0:1787582810.193667:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582810.193716:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787582810.193722:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186225536:0@lo:400:kworker.0 00000100:00100000:0.0:1787582810.193747:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582810.193778:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186225536 00000100:00100000:0.0:1787582810.193785:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186225536 00000100:00100000:0.0:1787582810.193830:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787582810.193840:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186225536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582810.193888:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186225536:12345-0@lo:400:kworker.0 Request processed in 49us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582810.193909:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787582810.193950:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186225536:0@lo:400:kworker.0 00000100:00100000:1.0:1787582810.194117:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186225152:0@lo:400:kworker.0 00000100:00100000:1.0:1787582810.194151:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582810.194182:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186225664:0@lo:400:kworker.0 00000100:00100000:1.0:1787582810.194203:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582810.194220:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787582810.194225:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186225280:0@lo:400:kworker.0 00000100:00100000:1.0:1787582810.194243:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582810.194258:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186225792:0@lo:400:kworker.0 00000100:00100000:1.0:1787582810.194276:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582810.194305:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186225408 00000100:00100000:1.0:1787582810.194309:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186225408 00000100:00100000:1.0:1787582810.194373:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186225792 00000100:00100000:1.0:1787582810.194376:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186225792 00000100:00100000:1.0:1787582810.194397:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787582810.194411:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186225408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582810.194447:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186225408:12345-0@lo:400:kworker.0 Request processed in 37us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582810.194453:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787582810.194466:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787582810.194472:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186225792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582810.194518:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186225792:12345-0@lo:400:kworker.0 Request processed in 45us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582810.194524:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787582810.194539:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787582810.194543:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582810.194551:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186225664 00000100:00100000:1.0:1787582810.194554:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186225664 00000100:00100000:1.0:1787582810.194576:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186225280 00000100:00100000:1.0:1787582810.194579:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186225280 00000100:00100000:1.0:1787582810.194589:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787582810.194594:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186225664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582810.194620:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186225664:12345-0@lo:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582810.194625:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787582810.194635:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787582810.194641:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186225280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582810.194664:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186225280:12345-0@lo:400:kworker.0 Request processed in 23us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582810.194670:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1787582810.194697:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582810.194715:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186225280:0@lo:400:kworker.0 00010000:00080000:1.0:1787582810.194733:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adf78a80 x1874416186225792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582810.194742:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186225792:0@lo:400:kworker.0 00000100:00100000:1.0:1787582810.194751:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186225664:0@lo:400:kworker.0 00000100:00100000:1.0:1787582810.194774:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186225408:0@lo:400:kworker.0 00000100:00100000:0.0:1787582810.194976:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186225152 00000100:00100000:0.0:1787582810.194980:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186225152 00000100:00100000:0.0:1787582810.195013:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787582810.195020:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3313:x1874416186225152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582810.195053:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3313:x1874416186225152:12345-0@lo:400:kworker.0 Request processed in 33us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582810.195059:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787582810.195372:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186225152:0@lo:400:kworker.0 00010000:00010000:3.0:1787582810.577097:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582810.710894:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186225920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582810.710970:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582810.711409:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186225920 00000100:00100000:3.0:1787582810.711417:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186225920 00000100:00100000:3.0:1787582810.711461:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787582810.711471:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186225920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787582810.711503:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582810.711550:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186225920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582810.711557:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1787582810.712310:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5ad9af800 x1874416186225920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582826 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582810.712476:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186225920:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787582811.349680:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787582811.602577:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582812.624592:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787582813.550000:0:11864:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:46:52 (1787582812) 00010000:00010000:3.0:1787582813.651733:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582814.173225:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582814.173312:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582814.173401:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582814.173578:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162071936 00000100:00100000:0.0:1787582814.173588:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162071936 00000100:00100000:0.0:1787582814.173642:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162071808 00000100:00100000:0.0:1787582814.173645:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162071808 00000100:00100000:0.0:1787582814.173662:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 127 00000100:00100000:0.0:1787582814.173671:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162071936:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582814.173735:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162071936:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 65us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582814.173743:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 127 00000100:00100000:0.0:1787582814.173758:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 128 00000100:00100000:0.0:1787582814.173765:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2357:x1874416162071808:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582814.173790:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2357:x1874416162071808:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582814.173796:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 128 00000100:00080000:2.0:1787582814.174877:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582814.175605:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162071680 00000100:00100000:3.0:1787582814.175614:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162071680 00000100:00100000:3.0:1787582814.175658:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 284 00000100:00100000:3.0:1787582814.175667:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2357:x1874416162071680:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582814.175730:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2357:x1874416162071680:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 65us (2513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582814.175736:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 284 00000100:00100000:3.0:1787582814.288736:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787582814.288758:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186226048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787582814.288850:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582814.289021:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186226048 00000100:00100000:2.0:1787582814.289030:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186226048 00000100:00100000:2.0:1787582814.289098:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787582814.289108:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186226048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582814.289141:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582814.289194:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186226048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582814.289202:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1787582814.289304:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582814.289376:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186226048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787582814.672489:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582815.183200:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582815.188178:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162072064 00000100:00100000:0.0:1787582815.188235:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162072064 00000100:00100000:0.0:1787582815.188370:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 32 00000100:00100000:0.0:1787582815.188383:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:10239:x1874416162072064:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787582815.188410:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582815.188440:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537ea5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57fbd expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.188529:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537eac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.188544:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537eac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.188559:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537eac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582815.188800:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787582815.188805:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582815.188910:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537eac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.188945:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537ea5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fbd expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.188969:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537eac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fbd expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.188978:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68600) 00010000:00010000:0.0:1787582815.188981:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787582815.188986:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580031a00, rc 0) 00000100:00100000:0.0:1787582815.189091:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:10239:x1874416162072064:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 709us (5906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582815.189099:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 32 00000100:00100000:1.0:1787582815.208585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582815.208994:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162072192 00000100:00100000:2.0:1787582815.209008:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162072192 00000100:00100000:2.0:1787582815.209095:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 33 00000100:00100000:2.0:1787582815.209108:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:10240:x1874416162072192:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787582815.209135:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582815.209173:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537eb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57fc4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.209256:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537eba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.209274:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537eba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.209286:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537eba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.209302:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537ec1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.209375:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.209382:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.210295:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d600/0xa113d808b7537ec8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.210495:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d600/0xa113d808b7537ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.210506:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d600/0xa113d808b7537ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582815.210615:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787582815.210620:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787582815.211275:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d600/0xa113d808b7537ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211295:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537eba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211302:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537eba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211424:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537eba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211432:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9c000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582815.211436:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537eba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211445:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537eba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211462:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68600) 00010000:00010000:2.0:1787582815.211479:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582815.211486:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537eba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211492:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537eba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211509:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211515:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211520:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211525:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9c800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582815.211528:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211535:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211543:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8da5a4492b00) 00010000:00010000:2.0:1787582815.211546:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582815.211549:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537ec1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211554:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537ec1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211602:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537eb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fc4 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211631:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d600/0xa113d808b7537ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fc4 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582815.211639:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8da5a4492e00) 00010000:00010000:2.0:1787582815.211642:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787582815.211644:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9d600, rc 0) 00000100:00100000:2.0:1787582815.212040:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:10240:x1874416162072192:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 2933us (3466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582815.212051:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 33 00000100:00100000:3.0:1787582815.217900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582815.218073:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162072448 00000100:00100000:0.0:1787582815.218092:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162072448 00000100:00100000:0.0:1787582815.218174:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 34 00000100:00100000:0.0:1787582815.218187:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:10240:x1874416162072448:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787582815.218213:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582815.218239:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537ecf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57fcb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.218392:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537ed6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.218411:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.218425:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.221394:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537edd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.221416:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537edd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.221429:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537edd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.222461:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef600/0xa113d808b7537ee4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.222484:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef600/0xa113d808b7537ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.222493:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef600/0xa113d808b7537ee4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582815.222506:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787582815.222714:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537ed6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.222722:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537ed6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.222728:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.222734:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580031e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582815.222738:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.222746:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537ed6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.222759:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8da5a4492e00) 00010000:00010000:0.0:1787582815.222762:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582815.222766:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537ed6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.222772:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7537ed6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.222784:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537edd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.222796:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537edd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.222802:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537edd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.222806:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580031400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582815.227980:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537edd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.228000:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537edd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.228019:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8da5a0b68300) 00010000:00010000:0.0:1787582815.228023:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582815.228028:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537edd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.228037:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7537edd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.228754:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7537ecf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fcb expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.228774:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef600/0xa113d808b7537ee4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fcb expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582815.228783:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8da5a0b68e00) 00010000:00010000:0.0:1787582815.228786:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582815.228796:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ef600, rc 0) 00000100:00100000:0.0:1787582815.229728:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:10240:x1874416162072448:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 11535us (11836us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787582815.229740:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 34 00000100:00100000:1.0:1787582815.247483:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582815.249240:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162072576 00000100:00100000:2.0:1787582815.249260:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162072576 00000100:00100000:2.0:1787582815.249380:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 35 00000100:00100000:2.0:1787582815.249395:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:10240:x1874416162072576:12345-192.168.206.20@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787582815.249768:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:10240:x1874416162072576:12345-192.168.206.20@tcp:59:lhsmtool_posix.0 Request processed in 376us (2291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582815.249788:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 35 00000100:00100000:0.0:1787582815.315555:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787582815.315635:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582815.315662:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186226304:0@lo:400:kworker.0 00000100:00100000:1.0:1787582815.315759:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582815.320909:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186226304 00000100:00100000:2.0:1787582815.320929:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186226304 00000100:00100000:2.0:1787582815.321018:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787582815.321030:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186226304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582815.321174:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186226304:12345-0@lo:400:kworker.0 Request processed in 147us (5414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582815.321183:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787582815.321240:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186226304:0@lo:400:kworker.0 00000100:00100000:0.0:1787582815.321832:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186226176:0@lo:400:kworker.0 00000100:00100000:0.0:1787582815.321892:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582815.321995:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186226176 00000100:00100000:1.0:1787582815.322001:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186226176 00000100:00100000:1.0:1787582815.322044:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787582815.322053:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3314:x1874416186226176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582815.322111:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3314:x1874416186226176:12345-0@lo:400:kworker.0 Request processed in 59us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582815.322117:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787582815.322382:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186226176:0@lo:400:kworker.0 00000100:00100000:3.0:1787582815.323024:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186226560:0@lo:400:kworker.0 00000100:00100000:3.0:1787582815.323071:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582815.323110:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787582815.323117:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186226432:0@lo:400:kworker.0 00000100:00100000:3.0:1787582815.323144:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582815.323302:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186226688:0@lo:400:kworker.0 00000100:00100000:0.0:1787582815.323430:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186226816:0@lo:400:kworker.0 00000100:00100000:1.0:1787582815.323556:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186226560 00000100:00100000:1.0:1787582815.323564:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186226560 00000100:00100000:1.0:1787582815.323621:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787582815.323634:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186226560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582815.327259:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582815.327769:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186226688 00000100:00100000:2.0:1787582815.327782:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186226688 00000100:00100000:2.0:1787582815.327855:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787582815.327867:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186226688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582815.327948:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186226688:12345-0@lo:400:kworker.0 Request processed in 84us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582815.327957:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787582815.328014:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186226688:0@lo:400:kworker.0 00000100:00100000:2.0:1787582815.328066:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186226432 00000100:00100000:2.0:1787582815.328071:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186226432 00000100:00100000:2.0:1787582815.328255:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787582815.328262:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186226432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582815.328300:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186226432:12345-0@lo:400:kworker.0 Request processed in 39us (5156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582815.328405:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1787582815.328431:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582815.328596:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186226432:0@lo:400:kworker.0 00000100:00100000:0.0:1787582815.328954:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582815.331864:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186226816 00000100:00100000:2.0:1787582815.331885:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186226816 00000100:00100000:2.0:1787582815.331998:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787582815.332011:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186226816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582815.332138:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186226816:12345-0@lo:400:kworker.0 Request processed in 129us (3183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582815.332146:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1787582815.332454:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5a8e0a300 x1874416186226816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787582831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582815.332473:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186226816:0@lo:400:kworker.0 00000100:00080000:3.0:1787582815.332639:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787582815.332959:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186226560:12345-0@lo:400:kworker.0 Request processed in 9324us (9885us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582815.332971:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787582815.334668:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186226560:0@lo:400:kworker.0 00000040:00080000:3.0:1787582815.442596:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787582815.697460:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582815.837388:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186226944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582815.837514:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582815.837659:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186226944 00000100:00100000:2.0:1787582815.837670:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186226944 00000100:00100000:2.0:1787582815.837730:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787582815.837741:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186226944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787582815.837783:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582815.837835:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186226944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582815.837843:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1787582815.845973:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adbce680 x1874416186226944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582815.846019:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186226944:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787582816.728833:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582817.526937:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582817.527079:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162072704 00000100:00100000:3.0:1787582817.527092:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162072704 00000100:00100000:3.0:1787582817.527173:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 36 00000100:00100000:3.0:1787582817.527187:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:10282:x1874416162072704:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:3.0:1787582817.527213:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582817.527238:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7537ef2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57fd2 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.527344:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537ef9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.527360:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.527392:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.527410:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.527418:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.527425:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.527927:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.527939:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537ef9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.527946:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.527953:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582817.527959:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.527968:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537ef9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.527984:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68600) 00010000:00010000:3.0:1787582817.527988:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582817.527994:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537ef9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.528006:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537ef9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.528022:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.528029:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.528035:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.528040:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582817.528044:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.528050:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.528059:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8da583acc500) 00010000:00010000:3.0:1787582817.528062:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582817.528064:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.528070:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.528112:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7537ef2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fd2 expref: 10 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.528136:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68600) 00010000:00010000:3.0:1787582817.528139:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582817.528143:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7537ef2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fd2 expref: 10 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.528155:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0200, rc 0) 00000100:00100000:3.0:1787582817.528252:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:10282:x1874416162072704:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 1067us (1328us total) trans 0 rc 301/301 00000100:00100000:3.0:1787582817.528261:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 36 00000100:00080000:0.0:1787582817.529586:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582817.539932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582817.540126:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162072960 00000100:00100000:2.0:1787582817.540143:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162072960 00000100:00100000:2.0:1787582817.540264:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 37 00000100:00100000:2.0:1787582817.540277:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:10282:x1874416162072960:12345-192.168.206.20@tcp:36:lfs.0 00010000:00010000:2.0:1787582817.540414:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582817.540474:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7537eac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fbd expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.540500:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68600) 00010000:00010000:2.0:1787582817.540514:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787582817.541258:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f07 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.541276:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.541288:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.541299:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537f0e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.541759:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537f0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.541769:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537f0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582817.543851:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787582817.543876:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f07 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.543887:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f07 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.543894:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f07 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.543901:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9c000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582817.543906:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f07 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.543914:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f07 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.543934:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:2.0:1787582817.543937:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582817.543943:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f07 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.543949:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f07 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787582817.543998:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c75ccca reply state 00000000d6b50d52 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537f0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582817.544010:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787582817.544212:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:10282:x1874416162072960:12345-192.168.206.20@tcp:36:lfs.0 Request processed in 3931us (4288us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787582817.544224:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 37 00010000:00010000:2.0:1787582817.548956:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537f0e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.548979:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537f0e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.548988:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537f0e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.548996:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9dc00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582817.549002:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537f0e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.549011:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537f0e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.549031:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8da5a4492100) 00010000:00010000:2.0:1787582817.549035:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582817.549041:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537f0e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.549047:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537f0e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582817.627967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582817.628140:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162073088 00000100:00100000:2.0:1787582817.628153:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162073088 00000100:00100000:2.0:1787582817.628224:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 38 00000100:00100000:2.0:1787582817.628237:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:10290:x1874416162073088:12345-192.168.206.20@tcp:101:lctl.0 00010000:00010000:2.0:1787582817.628273:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582817.628311:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537f15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57fd9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.628426:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.628443:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.628473:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582817.628556:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787582817.628560:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787582817.628613:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.628816:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537f15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fd9 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.628837:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fd9 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.628847:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492100) 00010000:00010000:2.0:1787582817.628865:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787582817.628869:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4e9c000, rc 0) 00000100:00100000:2.0:1787582817.628946:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:10290:x1874416162073088:12345-192.168.206.20@tcp:101:lctl.0 Request processed in 711us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582817.628954:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 38 00000100:00100000:2.0:1787582817.706290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582817.706374:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162073216 00000100:00100000:2.0:1787582817.706388:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162073216 00000100:00100000:2.0:1787582817.709384:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 39 00000100:00100000:2.0:1787582817.709415:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:10296:x1874416162073216:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:2.0:1787582817.709459:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582817.709490:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537f23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57fe0 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.709593:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537f2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.709607:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537f2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.709620:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537f2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.710933:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537f31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.710952:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.710965:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711267:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f600/0xa113d808b7537f38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711277:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f600/0xa113d808b7537f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711285:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f600/0xa113d808b7537f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582817.711356:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787582817.711361:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787582817.711418:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f600/0xa113d808b7537f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711433:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537f2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711441:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537f2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711448:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537f2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711813:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9ce00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582817.711819:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537f2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711828:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537f2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711845:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492100) 00010000:00010000:2.0:1787582817.711857:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582817.711863:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537f2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711870:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9ce00/0xa113d808b7537f2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711886:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711893:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537f31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711899:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537f31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711904:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9c800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582817.711907:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537f31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711912:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537f31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711918:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8da5a4492b00) 00010000:00010000:2.0:1787582817.711920:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582817.711923:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537f31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711928:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c800/0xa113d808b7537f31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.711973:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9dc00/0xa113d808b7537f23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fe0 expref: 12 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.712001:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f600/0xa113d808b7537f38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fe0 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.712009:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:2.0:1787582817.712012:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787582817.712015:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9f600, rc 0) 00000100:00100000:2.0:1787582817.713870:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+11:10296:x1874416162073216:12345-192.168.206.20@tcp:101:bash.0 Request processed in 4456us (7580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582817.713885:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 39 00000100:00100000:3.0:1787582817.718929:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582817.718982:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162073472 00000100:00100000:3.0:1787582817.718993:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162073472 00000100:00100000:3.0:1787582817.719056:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 40 00000100:00100000:3.0:1787582817.719069:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+11:10296:x1874416162073472:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:3.0:1787582817.719109:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582817.719136:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7537f3f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57fe7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.719455:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f46 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.719473:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.719487:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.723857:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537f4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.723879:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.723892:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787582817.729104:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787582817.729311:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7537f54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.729362:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7537f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.729374:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7537f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.729413:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f46 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.729422:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f46 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.729429:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.729435:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582817.729440:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f46 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.729459:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f46 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.729472:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:3.0:1787582817.729475:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582817.729479:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f46 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.729485:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7537f46 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787582817.729500:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df53dac3 reply state 00000000f63c1060 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582817.729509:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787582817.729544:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7537f3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fe7 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.729558:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7537f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fe7 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.729565:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acce00) 00010000:00010000:3.0:1787582817.729567:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787582817.729570:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0800, rc 0) 00000100:00100000:3.0:1787582817.729641:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:10296:x1874416162073472:12345-192.168.206.20@tcp:101:bash.0 Request processed in 10575us (10726us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787582817.729650:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 40 00000100:00100000:3.0:1787582817.736561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582817.736834:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162073600 00000100:00100000:2.0:1787582817.736852:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162073600 00000100:00100000:2.0:1787582817.736937:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 21 00000100:00100000:2.0:1787582817.736947:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1874416162073600:12345-192.168.206.20@tcp:8:bash.0 00010000:00080000:2.0:1787582817.736988:0:6703:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:2.0:1787582817.737041:0:6703:0:(genops.c:1385:class_connect()) connect: client 730f9f4f-46d8-441e-9162-5fde1074d6a5, cookie 0xa113d808b7537f62 00002000:00100000:2.0:1787582817.737057:0:6703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 730f9f4f-46d8-441e-9162-5fde1074d6a5/ffff8da590711800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00010000:00010000:1.0:1787582817.737398:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537f4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582817.737413:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537f4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582817.737420:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537f4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582817.737427:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582817.737432:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537f4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582817.737439:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537f4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582817.737472:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da583acc500) 00010000:00010000:1.0:1787582817.737475:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582817.737480:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537f4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582817.737486:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7537f4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1787582817.737791:0:6703:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787582817.738907:0:6703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787582817.738960:0:6703:0:(import.c:65:import_set_state_nolock()) ffff8da58df97800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787582817.739153:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2356:x1874416162073600:12345-192.168.206.20@tcp:8:bash.0 Request processed in 2203us (2597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582817.739166:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 21 00010000:00010000:2.0:1787582817.744707:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582817.746544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582817.747146:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162073728 00000100:00100000:1.0:1787582817.747160:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162073728 00000100:00100000:1.0:1787582817.747262:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 22 00000100:00100000:1.0:1787582817.747273:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:0:x1874416162073728:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:1.0:1787582817.747290:0:8218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582817.747312:0:8218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004299296c/0xa113d808b7537f69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57fee expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787582817.747403:0:8218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582817.747423:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1787582817.747427:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582817.747437:0:8218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004299296c/0xa113d808b7537f69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fee expref: 7 pid: 8218 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582817.747457:0:8218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004299296c/0xa113d808b7537f69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fee expref: 7 pid: 8218 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582817.747471:0:8218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6200, rc 0) 00000100:00100000:1.0:1787582817.747533:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:0:x1874416162073728:12345-192.168.206.20@tcp:101:bash.0 Request processed in 262us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582817.747553:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 22 00000100:00080000:0.0:1787582817.747704:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787582817.752416:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582817.752567:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162073856 00000100:00100000:3.0:1787582817.752576:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162073856 00000100:00100000:3.0:1787582817.752623:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 23 00000100:00100000:3.0:1787582817.752633:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:10296:x1874416162073856:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:3.0:1787582817.752650:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582817.752671:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57ff5 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.752700:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004299296c/0xa113d808b7537f69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fee expref: 8 pid: 8218 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.752709:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582817.752713:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582817.752719:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.752750:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004299296c/0xa113d808b7537f69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fee expref: 8 pid: 8218 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582817.752764:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004299296c/0xa113d808b7537f69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fee expref: 8 pid: 8218 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582817.752789:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1874416186227072:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582817.752930:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582817.762031:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e09f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1874416186227072:192.168.206.20@tcp:104: 00010000:00010000:2.0:1787582817.762067:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.762088:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0200, rc 0) 00000100:00100000:2.0:1787582817.762170:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:10296:x1874416162073856:12345-192.168.206.20@tcp:101:bash.0 Request processed in 9537us (9761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582817.762180:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 23 00000100:00100000:3.0:1787582817.762309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582817.762577:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162073984 00000100:00100000:0.0:1787582817.762585:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162073984 00010000:00010000:0.0:1787582817.762617:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004299296c/0xa113d808b7537f69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fee expref: 8 pid: 8218 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582817.764045:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 35 00000100:00100000:0.0:1787582817.764073:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2360:x1874416162073984:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787582817.764090:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582817.764118:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004299296c/0xa113d808b7537f69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fee expref: 8 pid: 8218 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582817.764136:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004299296c/0xa113d808b7537f69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fee expref: 8 pid: 8218 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582817.764162:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004299296c/0xa113d808b7537f69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fee expref: 8 pid: 8218 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582817.764178:0:8463:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582817.764183:0:8463:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582817.764192:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582817.764203:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582817.764242:0:8463:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582817.764257:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf7a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8463:1874416186227200:192.168.206.20@tcp:105: 00000100:00100000:0.0:1787582817.764357:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58b2f9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787582817.779495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582817.780235:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf7a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8463:1874416186227200:192.168.206.20@tcp:105: 00010000:00010000:1.0:1787582817.780273:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582817.780416:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2360:x1874416162073984:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 16346us (18125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582817.780430:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 35 00000100:00100000:3.0:1787582817.781891:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162074240 00000100:00100000:3.0:1787582817.781925:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162074240 00000100:00100000:3.0:1787582817.781997:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 6 00000100:00100000:3.0:1787582817.782008:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10296:x1874416162074240:12345-192.168.206.20@tcp:35:bash.0 00000100:00100000:2.0:1787582817.789105:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:10296:x1874416162074240:12345-192.168.206.20@tcp:35:bash.0 Request processed in 7084us (9606us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787582817.789123:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 6 00000100:00100000:0.0:1787582817.897282:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582817.897422:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162074496 00000100:00100000:2.0:1787582817.897445:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162074496 00000100:00100000:2.0:1787582817.897525:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 41 00000100:00100000:2.0:1787582817.897537:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:10306:x1874416162074496:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582817.897575:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582817.897600:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537f77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d57ffc expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582817.898030:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787582817.898184:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537f77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ffc expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.898202:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492100) 00010000:00010000:2.0:1787582817.898205:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787582817.898210:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537f77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ffc expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582817.898226:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9fe00, rc 0) 00000100:00100000:2.0:1787582817.899183:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:10306:x1874416162074496:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 1636us (1902us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787582817.899194:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 41 00000100:00100000:3.0:1787582817.904863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582817.904984:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162074752 00000100:00100000:1.0:1787582817.904997:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162074752 00000100:00100000:1.0:1787582817.905073:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 7 00000100:00100000:1.0:1787582817.905085:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:10306:x1874416162074752:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:1.0:1787582817.905483:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+16:10306:x1874416162074752:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 398us (634us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787582817.905492:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 7 00000100:00100000:3.0:1787582818.018977:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582818.019164:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162074880 00000100:00100000:2.0:1787582818.019176:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162074880 00000100:00100000:2.0:1787582818.019244:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 42 00000100:00100000:2.0:1787582818.019254:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+16:10312:x1874416162074880:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582818.019285:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582818.019310:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537f85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58003 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.019440:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7537f8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.019456:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7537f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.019472:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7537f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582818.019551:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787582818.019556:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787582818.019583:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7537f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.019614:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537f85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58003 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.019633:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7537f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58003 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.019642:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:2.0:1787582818.019645:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787582818.019669:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9fa00, rc 0) 00000100:00100000:2.0:1787582818.019750:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+17:10312:x1874416162074880:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 497us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582818.019758:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 42 00000100:00100000:2.0:1787582818.027818:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582818.028008:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162075136 00000100:00100000:1.0:1787582818.028020:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162075136 00000100:00100000:1.0:1787582818.028087:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 43 00000100:00100000:1.0:1787582818.028097:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+17:10312:x1874416162075136:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:1.0:1787582818.028122:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582818.028145:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7537f93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5800a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.028261:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7537f9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.028277:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7537f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.028362:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7537f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582818.028377:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787582818.028522:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7537f93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5800a expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.028543:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7537f9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5800a expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.028553:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acce00) 00010000:00010000:1.0:1787582818.028556:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582818.028559:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6200, rc 0) 00000100:00100000:1.0:1787582818.028615:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:10312:x1874416162075136:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 520us (811us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787582818.028621:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 43 00000100:00100000:0.0:1787582818.032812:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582818.032940:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162075264 00000100:00100000:2.0:1787582818.032953:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162075264 00000100:00100000:2.0:1787582818.033035:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 2 00000100:00100000:2.0:1787582818.033048:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:2359:x1874416162075264:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582818.033067:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582818.033098:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7537f9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5800a expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.033122:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acce00) 00010000:00010000:2.0:1787582818.033128:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582818.034604:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:2359:x1874416162075264:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 1543us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582818.034621:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 2 00000100:00100000:3.0:1787582818.037005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582818.037105:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162075520 00000100:00100000:2.0:1787582818.037119:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162075520 00000100:00100000:2.0:1787582818.037186:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 44 00000100:00100000:2.0:1787582818.037198:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:10312:x1874416162075520:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582818.037230:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582818.037255:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fa8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58011 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.037459:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7537faf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.037482:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7537faf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.037496:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7537faf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582818.037513:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787582818.037684:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fa8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58011 expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.037705:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7537faf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58011 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.037715:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acce00) 00010000:00010000:2.0:1787582818.037718:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787582818.037723:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9ee00, rc 0) 00000100:00100000:2.0:1787582818.037786:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+20:10312:x1874416162075520:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 590us (794us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787582818.037794:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 44 00000100:00100000:0.0:1787582818.047870:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582818.047984:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162075648 00000100:00100000:1.0:1787582818.047997:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162075648 00000100:00100000:1.0:1787582818.048079:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 24 00000100:00100000:1.0:1787582818.048091:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2357:x1874416162075648:12345-192.168.206.20@tcp:1:lfs.0 00010000:00010000:1.0:1787582818.048148:0:8218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032fdb808/0xa113d808b7537fbd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.048173:0:8218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.048182:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787582818.048204:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787582818.048209:0:8218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032fdb808/0xa113d808b7537fbd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.048257:0:8218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.048280:0:8218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 7 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582818.048299:0:8218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8218:1874416186227328:192.168.206.20@tcp:104: 00000100:00100000:1.0:1787582818.048460:0:8218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58921d480 going to sleep for 11 seconds 00000100:00100000:0.0:1787582818.054817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582818.054932:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162075776 00000100:00100000:2.0:1787582818.054943:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162075776 00002000:00100000:2.0:1787582818.055002:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8da5adf79880 x1874416162075776/t0(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:284/0 lens 504/0 e 0 to 0 dl 1787582829 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787582818.055015:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5adf79880 with x1874416162075776 ext(0->12) 00010000:00010000:2.0:1787582818.055025:0:6708:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 8 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.055061:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 8 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787582818.055069:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8da5adf79880 00000100:00100000:2.0:1787582818.055106:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 0 00000100:00100000:2.0:1787582818.055117:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2360:x1874416162075776:12345-192.168.206.20@tcp:4:lfs.0 00000100:00100000:1.0:1787582818.056987:0:8218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3eea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8218:1874416186227328:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582818.057023:0:8218:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000032fdb808/0xa113d808b7537fbd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1787582818.100426:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 730f9f4f-46d8-441e-9162-5fde1074d6a5 00000100:00100000:1.0:1787582818.172632:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:2360:x1874416162075776:12345-192.168.206.20@tcp:4:lfs.0 Request processed in 117507us (117820us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787582818.172651:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 0 00002000:00100000:1.0:1787582818.172664:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8da5adf79880 x1874416162075776/t4294967299(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:284/0 lens 504/448 e 0 to 0 dl 1787582829 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787582818.172675:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5adf79880 with x1874416162075776 ext(0->12) 00010000:00010000:1.0:1787582818.172686:0:6708:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 9 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.172723:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 9 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787582818.172730:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8da5adf79880 00000001:00080000:0.0:1787582818.172860:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1787582818.175797:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582818.176042:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162075904 00000100:00100000:2.0:1787582818.176053:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162075904 00010000:00010000:2.0:1787582818.176092:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 7 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582818.176554:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 36 00000100:00100000:2.0:1787582818.176566:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2358:x1874416162075904:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582818.176582:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787582818.176603:0:5838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787582818.176606:0:5838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787582818 00002000:00010000:2.0:1787582818.176608:0:5838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787582818 00002000:00010000:2.0:1787582818.176611:0:5838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787582818 00002000:00010000:2.0:1787582818.176613:0:5838:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1787582818.176620:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 7 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.176634:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 7 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.176677:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7537f70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ff5 expref: 7 pid: 6705 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.176694:0:5838:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787582818.176699:0:5838:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787582818.176704:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000032fdb808/0xa113d808b7537fbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.176714:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032fdb808/0xa113d808b7537fbd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.176934:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582818.176999:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e08380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162075904:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 434us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582818.177007:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 36 00010000:00010000:3.0:1787582818.177914:0:8218:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000032fdb808/0xa113d808b7537fbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582818.177928:0:8218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032fdb808/0xa113d808b7537fbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.178904:0:8218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032fdb808/0xa113d808b7537fbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.178918:0:8218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032fdb808/0xa113d808b7537fbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.178926:0:8218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032fdb808/0xa113d808b7537fbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.178933:0:8218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6e00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582818.178960:0:8218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032fdb808/0xa113d808b7537fbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.178970:0:8218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032fdb808/0xa113d808b7537fbd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.178988:0:8218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032fdb808/0xa113d808b7537fbd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.178996:0:8218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032fdb808/0xa113d808b7537fbd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582818.179075:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2357:x1874416162075648:12345-192.168.206.20@tcp:1:lfs.0 Request processed in 130982us (131214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582818.179085:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 24 00000100:00100000:3.0:1787582818.181935:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582818.182022:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162076160 00000100:00100000:2.0:1787582818.182036:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162076160 00000100:00100000:2.0:1787582818.182105:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 8 00000100:00100000:2.0:1787582818.182116:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+20:10312:x1874416162076160:12345-192.168.206.20@tcp:35:lfs.0 00000004:00010000:2.0:1787582818.182191:0:5857:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7537faf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58011 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787582818.182529:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787582818.182589:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787582818.183544:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787582818.183608:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.183634:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7537f54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fe7 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.183644:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fc4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.183679:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7537f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fe7 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.183696:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7537f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fe7 expref: 24 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582818.183711:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5857:1874416186227456:192.168.206.20@tcp:104: 00000100:00100000:2.0:1787582818.184176:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b618dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582818.195302:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5857:1874416186227456:192.168.206.20@tcp:104: 00010000:00010000:2.0:1787582818.195370:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582818.195629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582818.195710:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162076288 00000100:00100000:1.0:1787582818.195717:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162076288 00010000:00010000:1.0:1787582818.195752:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7537f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fe7 expref: 25 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582818.195788:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 37 00000100:00100000:1.0:1787582818.195797:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+25:2360:x1874416162076288:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582818.195810:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582818.195816:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7537f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fe7 expref: 25 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.195828:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7537f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fe7 expref: 25 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.195849:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7537f54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fe7 expref: 25 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.195866:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acce00) 00010000:00010000:1.0:1787582818.195871:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fc4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.195879:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.195898:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fc4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.195923:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582818.195979:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+24:2360:x1874416162076288:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 182us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582818.195986:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 37 00010000:00010000:3.0:1787582818.198952:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582818.198970:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787582818.199105:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1787582818.199616:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1787582818.199724:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e09f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1874416186227584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787582818.199783:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582818.199872:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582818.204839:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186227584 00000100:00100000:2.0:1787582818.204855:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186227584 00000100:00100000:2.0:1787582818.204932:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787582818.204943:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874416186227584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787582818.205063:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874416186227584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 123us (5279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582818.205070:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582818.205173:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e09f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1874416186227584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787582818.205837:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787582818.205911:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3eea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1874416186227712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787582818.205955:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582818.205976:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58921da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582818.206558:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186227712 00000100:00100000:2.0:1787582818.206573:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186227712 00000100:00100000:2.0:1787582818.206617:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787582818.206627:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874416186227712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787582818.206864:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5857:x1874416186227712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 238us (907us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787582818.206871:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582818.207506:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3eea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1874416186227712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787582818.207571:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787582818.207616:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fc4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.207627:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fc4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.207634:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.207640:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9fe00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582818.207645:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fc4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.207652:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fc4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.207676:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acce00) 00010000:00010000:1.0:1787582818.207679:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787582818.207684:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fc4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.207690:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7537fc4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787582818.207861:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787582818.208064:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787582818.208075:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359214756905ns, next at 360214754828ns, rc = 0 00000001:00080000:1.0:1787582818.208082:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787582818.208115:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acce00) 00010000:00010000:1.0:1787582818.208118:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787582818.208124:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7537faf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58011 expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787582818.208806:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787582818.208876:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+27:10312:x1874416162076160:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 26759us (26962us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787582818.208885:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 8 00000020:00080000:1.0:1787582818.208890:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787582818.213857:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582818.213933:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162076416 00000100:00100000:1.0:1787582818.213943:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162076416 00000100:00100000:1.0:1787582818.214004:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 45 00000100:00100000:1.0:1787582818.214014:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+27:10312:x1874416162076416:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:1.0:1787582818.214036:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582818.214059:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7537fcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58018 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.214133:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7537fcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58018 expref: 28 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.214161:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7537fcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58018 expref: 28 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.214181:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:1.0:1787582818.214184:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787582818.214188:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7000, rc 0) 00000100:00100000:1.0:1787582818.214247:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+28:10312:x1874416162076416:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 234us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582818.214254:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 45 00000100:00100000:0.0:1787582818.219070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582818.219176:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162076672 00000100:00100000:1.0:1787582818.219184:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162076672 00000100:00100000:1.0:1787582818.219241:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:1.0:1787582818.219251:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5836ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+28:10312:x1874416162076672:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:1.0:1787582818.219496:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5836ab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+29:10312:x1874416162076672:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 246us (434us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787582818.219503:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:3.0:1787582818.311458:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582818.311560:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162076928 00000100:00100000:2.0:1787582818.311570:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162076928 00000100:00100000:2.0:1787582818.311626:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 46 00000100:00100000:2.0:1787582818.311638:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+29:10322:x1874416162076928:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582818.311661:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582818.311680:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7537fd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5801f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582818.311782:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787582818.311897:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7537fd2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5801f expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.311913:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492100) 00010000:00010000:2.0:1787582818.311916:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787582818.311921:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7537fd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5801f expref: 31 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.311933:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9e200, rc 0) 00000100:00100000:2.0:1787582818.311994:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+30:10322:x1874416162076928:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 359us (544us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787582818.312002:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 46 00000100:00100000:2.0:1787582818.317744:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582818.317829:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162077056 00000100:00100000:1.0:1787582818.317838:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162077056 00000100:00100000:1.0:1787582818.317890:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 47 00000100:00100000:1.0:1787582818.317900:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+30:10322:x1874416162077056:12345-192.168.206.20@tcp:34:lfs.0 00010000:00010000:1.0:1787582818.317967:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7537fe0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.317998:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7537fe0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318008:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7537fe0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318023:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7537fe7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318029:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7537fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318035:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7537fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318121:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7537fee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318128:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7537fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318226:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7537fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787582818.318267:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7537fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318279:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7537fe0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318293:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7537fe0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318310:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7537fe0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318347:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582818.318351:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7537fe0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318359:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7537fe0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318371:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:1.0:1787582818.318374:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582818.318377:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7537fe0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318383:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7537fe0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318394:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7537fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318400:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7537fe7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318405:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7537fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318409:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582818.318412:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7537fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318425:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7537fe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318432:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da58533ff00) 00010000:00010000:1.0:1787582818.318435:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582818.318437:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7537fe7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318442:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7537fe7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318454:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7537fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318460:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7537fee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318465:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7537fee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318470:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582818.318473:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7537fee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318479:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7537fee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318485:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:1.0:1787582818.318486:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582818.318489:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7537fee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.318502:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7537fee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582818.318569:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+30:10322:x1874416162077056:12345-192.168.206.20@tcp:34:lfs.0 Request processed in 670us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582818.318576:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 47 00000100:00100000:0.0:1787582818.325420:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582818.325505:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162077312 00000100:00100000:1.0:1787582818.325515:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162077312 00000100:00100000:1.0:1787582818.325567:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00100000:1.0:1787582818.325576:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+30:10322:x1874416162077312:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:1.0:1787582818.325823:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+31:10322:x1874416162077312:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 247us (410us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1787582818.325832:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00100000:3.0:1787582818.398982:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582818.399097:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162077568 00000100:00100000:2.0:1787582818.399108:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162077568 00000100:00100000:2.0:1787582818.399167:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 48 00000100:00100000:2.0:1787582818.399177:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+31:10325:x1874416162077568:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582818.399198:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582818.399216:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7537ff5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58026 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.399299:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7537ffc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.399354:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7537ffc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.399366:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7537ffc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.399382:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538003 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.399389:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.399394:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.399512:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b753800a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.399520:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b753800a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.399554:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b753800a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582818.399562:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787582818.399936:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7537ffc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.399944:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7537ffc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.399951:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7537ffc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.399957:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9e400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582818.399961:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7537ffc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.399968:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7537ffc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.399981:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:2.0:1787582818.399984:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582818.399987:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7537ffc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.399993:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7537ffc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.400005:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.400011:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538003 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.400024:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.400030:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9ec00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582818.400033:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.400039:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538003 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.400048:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da5a4492a00) 00010000:00010000:2.0:1787582818.400051:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582818.400053:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538003 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.400058:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538003 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.400108:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7537ff5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58026 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.400119:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b753800a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58026 expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.400125:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:2.0:1787582818.400127:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787582818.400129:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9f000, rc 0) 00000100:00100000:2.0:1787582818.400238:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+33:10325:x1874416162077568:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 1062us (1264us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787582818.400254:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 48 00000100:00100000:3.0:1787582818.408683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582818.408781:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162077696 00000100:00100000:2.0:1787582818.408790:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162077696 00000100:00100000:2.0:1787582818.408847:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 49 00000100:00100000:2.0:1787582818.408857:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+33:10325:x1874416162077696:12345-192.168.206.20@tcp:54:lfs.0 00010000:00010000:2.0:1787582818.408920:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538018 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.408936:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.408947:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.408981:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.408988:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538018 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.408999:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.409005:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9e800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582818.409010:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.409016:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538018 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.409026:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:2.0:1787582818.409035:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787582818.409040:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538018 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.409045:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538018 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582818.409125:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+33:10325:x1874416162077696:12345-192.168.206.20@tcp:54:lfs.0 Request processed in 270us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582818.409133:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 49 00000100:00100000:0.0:1787582818.414564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582818.414642:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162077952 00000100:00100000:2.0:1787582818.414651:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162077952 00000100:00100000:2.0:1787582818.414704:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00100000:2.0:1787582818.414714:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+33:10325:x1874416162077952:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:2.0:1787582818.414934:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+34:10325:x1874416162077952:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 221us (378us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787582818.414942:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00100000:3.0:1787582818.697502:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582818.697697:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162078208 00000100:00100000:0.0:1787582818.697707:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162078208 00000100:00100000:0.0:1787582818.697772:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 50 00000100:00100000:0.0:1787582818.697782:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+34:10356:x1874416162078208:12345-192.168.206.20@tcp:101:cat.0 00010000:00010000:0.0:1787582818.697805:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582818.697827:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753801f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5802d expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582818.697927:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582818.697941:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582818.697953:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582818.697964:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787582818.698234:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753801f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5802d expref: 37 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582818.698271:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5802d expref: 36 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582818.698280:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:0.0:1787582818.698292:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582818.698296:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ee200, rc 0) 00000100:00100000:0.0:1787582818.698455:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+36:10356:x1874416162078208:12345-192.168.206.20@tcp:101:cat.0 Request processed in 674us (963us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1787582818.698463:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 50 00000100:00100000:3.0:1787582818.720472:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582818.720840:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162078592 00000100:00100000:0.0:1787582818.720849:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162078592 00000100:00100000:0.0:1787582818.720911:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:0.0:1787582818.720921:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+36:10356:x1874416162078592:12345-192.168.206.20@tcp:35:cat.0 00000100:00100000:0.0:1787582818.721175:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+37:10356:x1874416162078592:12345-192.168.206.20@tcp:35:cat.0 Request processed in 256us (721us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787582818.721183:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:3.0:1787582818.723625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582818.723921:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162078336 00000100:00100000:1.0:1787582818.723931:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162078336 00000100:00100000:1.0:1787582818.723995:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 3 00000100:00100000:1.0:1787582818.724006:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5911a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+37:2358:x1874416162078336:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582818.724022:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582818.724049:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538026 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5802d expref: 37 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.724079:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:1.0:1787582818.724083:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582818.724138:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5911a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+36:2358:x1874416162078336:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 133us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582818.724146:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 3 00010000:00010000:2.0:1787582818.769493:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582818.803674:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582818.803802:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162078848 00000100:00100000:2.0:1787582818.803813:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162078848 00000100:00100000:2.0:1787582818.803875:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 51 00000100:00100000:2.0:1787582818.804274:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+36:10363:x1874416162078848:12345-192.168.206.20@tcp:101:dd.0 00010000:00010000:2.0:1787582818.804307:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582818.804340:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787582818.804365:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7537f8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58003 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.804383:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:2.0:1787582818.804399:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787582818.804412:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538034 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58034 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.804500:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.804515:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b753800a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58026 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.804523:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.804554:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b753800a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58026 expref: 36 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.804569:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b753800a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58026 expref: 36 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582818.804582:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186227840:192.168.206.20@tcp:104: 00000100:00100000:2.0:1787582818.804687:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b618d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787582818.808455:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582818.808577:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186227840:192.168.206.20@tcp:104: 00010000:00010000:2.0:1787582818.808602:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582818.811139:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162078976 00000100:00100000:1.0:1787582818.811155:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162078976 00010000:00010000:1.0:1787582818.811203:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b753800a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58026 expref: 37 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582818.813922:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 38 00000100:00100000:1.0:1787582818.813946:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+37:2360:x1874416162078976:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582818.813964:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582818.813976:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b753800a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58026 expref: 37 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.813994:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b753800a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58026 expref: 37 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.814096:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b753800a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58026 expref: 37 pid: 5854 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.814115:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:1.0:1787582818.814120:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.814128:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.814136:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582818.814242:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582818.814342:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+36:2360:x1874416162078976:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 407us (5894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582818.814363:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 38 00010000:00010000:3.0:1787582818.817235:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582818.817253:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582818.817276:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787582818.818540:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538034 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58034 expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582818.818568:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58034 expref: 36 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582818.818577:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:3.0:1787582818.818580:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787582818.818583:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9e200, rc 0) 00000100:00100000:3.0:1787582818.818699:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+36:10363:x1874416162078848:12345-192.168.206.20@tcp:101:dd.0 Request processed in 14815us (15036us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787582818.818708:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 51 00000100:00100000:3.0:1787582818.827464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582818.827592:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162079232 00000100:00100000:0.0:1787582818.827601:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162079232 00000100:00100000:0.0:1787582818.827655:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 52 00000100:00100000:0.0:1787582818.827665:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+36:10363:x1874416162079232:12345-192.168.206.20@tcp:36:dd.0 00010000:00010000:0.0:1787582818.827925:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538049 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582818.827941:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538049 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582818.827968:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538049 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787582818.828237:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1787582818.828267:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e03b901d reply state 0000000032319b45 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538049 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582818.828277:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787582818.828755:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+39:10363:x1874416162079232:12345-192.168.206.20@tcp:36:dd.0 Request processed in 1089us (1298us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787582818.828762:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 52 00000020:00080000:0.0:1787582818.828767:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787582818.832520:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538049 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.832538:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538049 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.832557:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538049 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.832563:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20eee00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582818.832567:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538049 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.832574:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538049 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.832590:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:2.0:1787582818.832593:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582818.832598:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538049 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582818.832604:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538049 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582819.217971:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582819.222639:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162079360 00000100:00100000:1.0:1787582819.222652:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162079360 00000100:00080000:0.0:1787582819.222909:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582819.222975:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 53 00000100:00100000:1.0:1787582819.222987:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+38:10377:x1874416162079360:12345-192.168.206.20@tcp:101:stat.0 00010000:00010000:1.0:1787582819.223010:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582819.223030:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538050 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5803b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.223093:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538057 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.223106:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.223232:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.223250:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b753805e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.223257:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b753805e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.223264:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b753805e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.223456:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.223485:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58034 expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.223494:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538065 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.223528:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58034 expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.223544:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58034 expref: 39 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582819.223557:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1874416186227968:192.168.206.20@tcp:104: 00000100:00100000:1.0:1787582819.223829:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5884a7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787582819.231429:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582819.231587:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162079616 00000100:00100000:3.0:1787582819.231596:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162079616 00000100:00100000:3.0:1787582819.231642:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:3.0:1787582819.231660:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+40:5596:x1874416162079616:12345-192.168.206.20@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787582819.232368:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+41:5596:x1874416162079616:12345-192.168.206.20@tcp:35:ldlm_bl.0 Request processed in 707us (944us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787582819.232377:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:1.0:1787582819.237160:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1874416186227968:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582819.237195:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582819.240692:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582819.240899:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162079744 00000100:00100000:1.0:1787582819.240909:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162079744 00010000:00010000:1.0:1787582819.240956:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58034 expref: 41 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582819.240996:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 39 00000100:00100000:1.0:1787582819.241006:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+41:2359:x1874416162079744:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582819.241020:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582819.241040:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58034 expref: 41 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.241054:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58034 expref: 41 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.241076:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b753803b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58034 expref: 41 pid: 5852 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.241092:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:1.0:1787582819.241097:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.241106:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.241119:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538065 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.241152:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582819.241205:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+40:2359:x1874416162079744:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 201us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582819.241213:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 39 00010000:00010000:0.0:1787582819.242057:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242070:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582819.242114:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787582819.242118:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582819.242157:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242172:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242181:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538057 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242197:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538057 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242205:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538057 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242211:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582819.242215:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538057 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242222:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538057 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242235:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:0.0:1787582819.242238:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582819.242242:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538057 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242249:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538057 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242261:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b753805e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242268:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b753805e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242275:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b753805e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242279:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582819.242300:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b753805e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242307:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b753805e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242355:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da58533ff00) 00010000:00010000:0.0:1787582819.242357:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582819.242361:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b753805e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242367:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b753805e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242405:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5803b expref: 40 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242418:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538065 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5803b expref: 39 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.242425:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:0.0:1787582819.242427:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582819.242430:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7200, rc 0) 00000100:00100000:0.0:1787582819.242479:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+39:10377:x1874416162079360:12345-192.168.206.20@tcp:101:stat.0 Request processed in 19495us (24516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582819.242487:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 53 00000100:00100000:0.0:1787582819.284134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582819.284185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582819.284226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582819.284365:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162080128 00000100:00100000:3.0:1787582819.284375:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162080128 00000100:00100000:3.0:1787582819.284436:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 132 00000100:00100000:3.0:1787582819.284446:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+5:2358:x1874416162080128:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582819.284518:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+5:2358:x1874416162080128:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 73us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582819.284526:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 132 00000100:00100000:1.0:1787582819.284766:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162080000 00000100:00100000:1.0:1787582819.284771:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162080000 00000100:00100000:1.0:1787582819.284807:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 72 00000100:00100000:1.0:1787582819.284815:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162080000:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582819.284851:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162080000:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 37us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582819.284873:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 72 00000100:00100000:2.0:1787582819.285184:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162079872 00000100:00100000:2.0:1787582819.285189:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162079872 00000100:00100000:2.0:1787582819.285226:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 286 00000100:00100000:2.0:1787582819.285233:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2358:x1874416162079872:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582819.285269:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2358:x1874416162079872:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 36us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582819.285275:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 286 00000100:00080000:0.0:1787582819.285355:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787582819.285366:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582819.323044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582819.324253:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162080384 00000100:00100000:2.0:1787582819.324268:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162080384 00000100:00100000:2.0:1787582819.324367:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 54 00000100:00100000:2.0:1787582819.324377:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+39:10383:x1874416162080384:12345-192.168.206.20@tcp:36:truncate.0 00010000:00010000:2.0:1787582819.324444:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582819.324552:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538065 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5803b expref: 39 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.324575:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:2.0:1787582819.324580:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787582819.324857:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b753806c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.324870:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b753806c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.324880:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b753806c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787582819.324947:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787582819.324972:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a738053 reply state 00000000673028f0 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b753806c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582819.324981:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787582819.325149:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+41:10383:x1874416162080384:12345-192.168.206.20@tcp:36:truncate.0 Request processed in 773us (2119us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787582819.325157:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 54 00000020:00080000:2.0:1787582819.325162:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787582819.331967:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b753806c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.331993:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b753806c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.332001:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b753806c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.332008:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9e400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582819.332012:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b753806c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.332019:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b753806c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.332035:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:1.0:1787582819.332038:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582819.332043:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b753806c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.332048:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b753806c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582819.412903:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186228096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787582819.412970:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582819.413262:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186228096 00000100:00100000:2.0:1787582819.413270:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186228096 00000100:00100000:2.0:1787582819.413370:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787582819.413380:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186228096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582819.413413:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582819.413484:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186228096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582819.413490:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787582819.413784:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186228096:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787582819.413855:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582819.530172:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582819.530282:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162080512 00000100:00100000:0.0:1787582819.530298:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162080512 00000100:00100000:0.0:1787582819.530397:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 55 00000100:00100000:0.0:1787582819.530407:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+40:10397:x1874416162080512:12345-192.168.206.20@tcp:101:stat.0 00010000:00010000:0.0:1787582819.530428:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582819.530447:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538073 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58042 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530511:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753807a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530525:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753807a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530536:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753807a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530553:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538081 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530561:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530589:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530775:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538088 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530784:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530806:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582819.530842:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787582819.530847:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582819.530865:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530877:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530885:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753807a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530892:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753807a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530900:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753807a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530905:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efe00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582819.530910:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753807a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530917:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753807a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530928:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:0.0:1787582819.530931:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582819.530936:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753807a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530952:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753807a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530965:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530972:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538081 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530977:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530982:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582819.530985:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530991:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538081 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.530999:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da5a0b68400) 00010000:00010000:0.0:1787582819.531001:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582819.531004:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538081 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.531010:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538081 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.531040:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538073 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58042 expref: 42 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.531053:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58042 expref: 41 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.531066:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:0.0:1787582819.531069:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582819.531072:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ee400, rc 0) 00000100:00100000:0.0:1787582819.531134:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+41:10397:x1874416162080512:12345-192.168.206.20@tcp:101:stat.0 Request processed in 728us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582819.531141:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 55 00000100:00100000:3.0:1787582819.618214:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582819.618448:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162080768 00000100:00100000:0.0:1787582819.618459:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162080768 00000100:00100000:0.0:1787582819.618581:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 56 00000100:00100000:0.0:1787582819.618593:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+41:10407:x1874416162080768:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582819.618620:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582819.618651:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b753808f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58049 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582819.618799:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787582819.618960:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b753808f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58049 expref: 43 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.618976:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492100) 00010000:00010000:0.0:1787582819.618980:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787582819.618985:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b753808f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58049 expref: 43 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.619003:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ee200, rc 0) 00000100:00100000:0.0:1787582819.619250:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+42:10407:x1874416162080768:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 658us (1118us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1787582819.619277:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 56 00000100:00100000:1.0:1787582819.623593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582819.623731:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162081024 00000100:00100000:2.0:1787582819.623744:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162081024 00000100:00100000:2.0:1787582819.623814:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:2.0:1787582819.623825:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+42:10407:x1874416162081024:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:2.0:1787582819.624520:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+43:10407:x1874416162081024:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 692us (938us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787582819.624539:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:3.0:1787582819.674397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582819.674504:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162081280 00000100:00100000:0.0:1787582819.674516:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162081280 00000100:00100000:0.0:1787582819.674599:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 57 00000100:00100000:0.0:1787582819.674611:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+43:10413:x1874416162081280:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:0.0:1787582819.674641:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582819.674667:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b753809d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58050 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.674791:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.674808:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538088 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58042 expref: 44 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.674818:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.674860:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58042 expref: 44 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.674876:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538088 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58042 expref: 44 pid: 7653 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582819.674892:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892de300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1874416186228224:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582819.675011:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8e77c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787582819.678376:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582819.678648:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162081408 00000100:00100000:2.0:1787582819.678661:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162081408 00010000:00010000:2.0:1787582819.678720:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538088 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58042 expref: 45 pid: 7653 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582819.678773:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 40 00000100:00100000:2.0:1787582819.678784:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+45:2359:x1874416162081408:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582819.678800:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582819.678808:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538088 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58042 expref: 45 pid: 7653 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582819.678808:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892de300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1874416186228224:192.168.206.20@tcp:104: 00010000:00010000:2.0:1787582819.678821:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58042 expref: 45 pid: 7653 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.678847:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538088 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58042 expref: 45 pid: 7653 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.678853:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.678876:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:2.0:1787582819.678882:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.678892:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.678901:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.678940:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787582819.678997:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.679005:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582819.679013:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+44:2359:x1874416162081408:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 231us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582819.679021:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 40 00000004:00200000:0.0:1787582819.679028:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1787582819.679238:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b753809d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58050 expref: 45 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.679255:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58050 expref: 44 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582819.679264:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:0.0:1787582819.679266:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787582819.679269:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ee000, rc 0) 00000100:00100000:0.0:1787582819.679856:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+44:10413:x1874416162081280:12345-192.168.206.20@tcp:101:bash.0 Request processed in 5243us (5467us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1787582819.679866:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 57 00000100:00100000:1.0:1787582819.684179:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582819.685771:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162081664 00000100:00100000:2.0:1787582819.685791:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162081664 00000100:00100000:2.0:1787582819.685877:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 58 00000100:00100000:2.0:1787582819.685890:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+44:10413:x1874416162081664:12345-192.168.206.20@tcp:36:bash.0 00010000:00010000:2.0:1787582819.686783:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b75380b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.686811:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b75380b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.686825:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b75380b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787582819.686889:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1787582819.686917:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bfb9cb0 reply state 000000007455bbab transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b75380b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582819.686945:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787582819.687201:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+47:10413:x1874416162081664:12345-192.168.206.20@tcp:36:bash.0 Request processed in 1310us (3030us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1787582819.687210:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 58 00000020:00080000:2.0:1787582819.687218:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787582819.691287:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b75380b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.691356:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b75380b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.691365:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b75380b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.691371:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9e600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582819.691378:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b75380b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.691387:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b75380b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.691407:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:2.0:1787582819.691410:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582819.691415:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b75380b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582819.691421:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b75380b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582819.697646:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582819.697774:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162081792 00000100:00100000:3.0:1787582819.697787:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162081792 00000100:00100000:3.0:1787582819.697895:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 59 00000100:00100000:3.0:1787582819.697906:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+46:10413:x1874416162081792:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:3.0:1787582819.697937:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582819.697965:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58057 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.698107:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75380c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.698135:0:7653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58050 expref: 47 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.698144:0:7653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75380c0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.698186:0:7653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58050 expref: 47 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.698203:0:7653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58050 expref: 47 pid: 5854 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582819.698220:0:7653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b35c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1874416186228352:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582819.698408:0:7653:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582819.702698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582819.702795:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162081920 00000100:00100000:1.0:1787582819.702821:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162081920 00010000:00010000:1.0:1787582819.702871:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58050 expref: 48 pid: 5854 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582819.702954:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 41 00000100:00100000:1.0:1787582819.702967:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+48:2360:x1874416162081920:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582819.702986:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582819.702994:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58050 expref: 48 pid: 5854 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.703010:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58050 expref: 48 pid: 5854 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.703038:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:1.0:1787582819.703044:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75380c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.703176:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75380c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.703188:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75380c0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.703215:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582819.703289:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+48:2360:x1874416162081920:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 318us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582819.703298:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 41 00010000:00010000:3.0:1787582819.703607:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75380a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58050 expref: 47 pid: 5854 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582819.703629:0:7653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b35c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1874416186228352:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582819.703655:0:7653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75380c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.703664:0:7653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75380c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.703685:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75380c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582819.703742:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787582819.703747:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787582819.703772:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75380c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.703805:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58057 expref: 47 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.703823:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75380c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58057 expref: 46 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.703832:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:3.0:1787582819.703835:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787582819.703838:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0600, rc 0) 00000100:00100000:3.0:1787582819.703879:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+46:10413:x1874416162081792:12345-192.168.206.20@tcp:101:bash.0 Request processed in 5975us (6248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582819.703887:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 59 00000100:00100000:0.0:1787582819.707227:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582819.707425:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162082176 00000100:00100000:2.0:1787582819.707454:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162082176 00000100:00100000:2.0:1787582819.707522:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 15 00000100:00100000:2.0:1787582819.707533:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5836ab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+46:10413:x1874416162082176:12345-192.168.206.20@tcp:35:bash.0 00000100:00100000:2.0:1787582819.707917:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5836ab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+47:10413:x1874416162082176:12345-192.168.206.20@tcp:35:bash.0 Request processed in 384us (703us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787582819.707926:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 15 00010000:00010000:0.0:1787582819.792765:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582819.797530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582819.797933:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162082432 00000100:00100000:1.0:1787582819.797948:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162082432 00000100:00100000:1.0:1787582819.798115:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 60 00000100:00100000:1.0:1787582819.798129:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+47:10423:x1874416162082432:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:1.0:1787582819.798161:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582819.798188:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b75380c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5805e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582819.798646:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787582819.798805:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b75380c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5805e expref: 49 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.798824:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492100) 00010000:00010000:1.0:1787582819.798828:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787582819.798833:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b75380c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5805e expref: 49 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.798852:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7a00, rc 0) 00000100:00100000:1.0:1787582819.798938:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+48:10423:x1874416162082432:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 812us (1423us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787582819.798947:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 60 00000100:00100000:0.0:1787582819.804736:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582819.806445:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162082560 00000100:00100000:3.0:1787582819.806465:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162082560 00000100:00100000:3.0:1787582819.806595:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 61 00000100:00100000:3.0:1787582819.806608:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+48:10423:x1874416162082560:12345-192.168.206.20@tcp:34:lfs.0 00010000:00010000:3.0:1787582819.806710:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.806732:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.806762:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.806783:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.806791:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.806799:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809706:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75380e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809733:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75380e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809748:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75380e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787582819.809823:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75380e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809840:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809847:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809854:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809882:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582819.809888:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809896:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809911:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:3.0:1787582819.809915:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582819.809920:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809927:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809947:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809953:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809959:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809964:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582819.809967:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809973:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.809993:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da583accb00) 00010000:00010000:3.0:1787582819.809995:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582819.809998:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.810005:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.810024:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75380e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.810030:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75380e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.810036:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75380e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.810041:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582819.810044:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75380e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.810195:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75380e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.810205:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:3.0:1787582819.810208:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582819.810211:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75380e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.810217:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75380e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582819.810718:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+48:10423:x1874416162082560:12345-192.168.206.20@tcp:34:lfs.0 Request processed in 4105us (5988us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582819.810730:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 61 00000100:00100000:0.0:1787582819.815584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582819.815697:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162082816 00000100:00100000:2.0:1787582819.815710:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162082816 00000100:00100000:2.0:1787582819.815779:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:2.0:1787582819.815791:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+48:10423:x1874416162082816:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:2.0:1787582819.816189:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+49:10423:x1874416162082816:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 398us (616us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787582819.816199:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:2.0:1787582819.859968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582819.860090:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162083072 00000100:00100000:3.0:1787582819.860103:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162083072 00000100:00100000:3.0:1787582819.860179:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 62 00000100:00100000:3.0:1787582819.860191:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+49:10426:x1874416162083072:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:3.0:1787582819.860222:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582819.860248:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75380ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58065 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.860611:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380f1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.860628:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.860640:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.860656:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.860664:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.860671:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.861170:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75380ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.861182:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75380ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.861190:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75380ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582819.861200:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787582819.861356:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380f1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.861364:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.861384:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.861390:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582819.862139:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.862151:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.862167:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:3.0:1787582819.862171:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582819.862176:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.862202:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75380f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.862224:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.862230:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.862237:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.862242:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582819.862245:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.862251:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.862259:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da583accb00) 00010000:00010000:3.0:1787582819.862261:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582819.862264:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.862269:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75380f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.863209:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75380ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58065 expref: 52 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.863237:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75380ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58065 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.863260:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:3.0:1787582819.863263:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787582819.863267:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0400, rc 0) 00000100:00100000:3.0:1787582819.864136:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+51:10426:x1874416162083072:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 3937us (4171us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1787582819.864149:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 62 00000100:00100000:0.0:1787582819.875574:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582819.876129:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162083328 00000100:00100000:1.0:1787582819.876143:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162083328 00000100:00100000:1.0:1787582819.876231:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 4 00000100:00100000:1.0:1787582819.876243:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+51:2357:x1874416162083328:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582819.876263:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582819.876296:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75380ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58065 expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582819.876569:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:1.0:1787582819.876575:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582819.876653:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+50:2357:x1874416162083328:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 412us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582819.876661:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 4 00000100:00100000:0.0:1787582819.884741:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582819.884933:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162083200 00000100:00100000:3.0:1787582819.884946:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162083200 00000100:00100000:3.0:1787582819.885016:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 63 00000100:00100000:3.0:1787582819.885028:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+50:10426:x1874416162083200:12345-192.168.206.20@tcp:54:lfs.0 00010000:00010000:3.0:1787582819.885121:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753810d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.885139:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753810d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.885151:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753810d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.885182:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753810d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.885189:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753810d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.885196:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753810d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.885203:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582819.885226:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753810d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.885234:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753810d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.885247:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:3.0:1787582819.885251:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787582819.885255:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753810d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582819.885262:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753810d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582819.885928:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+50:10426:x1874416162083200:12345-192.168.206.20@tcp:54:lfs.0 Request processed in 894us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582819.885940:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 63 00000100:00100000:2.0:1787582819.902615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582819.904872:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162083584 00000100:00100000:0.0:1787582819.904893:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162083584 00000100:00100000:0.0:1787582819.905058:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 17 00000100:00100000:0.0:1787582819.905072:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+50:10426:x1874416162083584:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:0.0:1787582819.905684:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+51:10426:x1874416162083584:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 611us (3079us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787582819.905695:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 17 00000001:00080000:0.0:1787582820.008604:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000004:00080000:0.0:1787582820.008638:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1787582820.008667:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8da58921dc00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787582820.008673:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da5bf8ea300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8da58921d480 00000020:00080000:0.0:1787582820.008676:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da5bf8ea400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8da5bf8fa000 00000020:00080000:2.0:1787582820.008750:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787582820.008944:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787582820.009047:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787582820.018793:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186228480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787582820.019237:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582820.019443:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186228480 00000100:00100000:2.0:1787582820.019453:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186228480 00000100:00100000:2.0:1787582820.019529:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787582820.019540:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1874416186228480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787582820.019567:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1787582820.019598:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8c5962, atime: 0x6a8c5962, ctime: 0x6a8c5962, blocks: 0xb 00010000:00010000:2.0:1787582820.019605:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b7538114 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582820.019636:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1787582820.019640:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787582820.019646:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b7538114 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582820.019661:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b7538114 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582820.019670:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b7538114 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787582820.019674:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787582820.019681:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b7538114 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582820.019706:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582820.019778:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582820.019785:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b7538114 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.019795:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9f200 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582820.019800:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b7538114 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.019810:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b7538114 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.019836:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b7538114 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.019844:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b7538114 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.019863:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582820.019865:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582820.019867:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582820.020620:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1874416186228480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1080us (1381us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787582820.020629:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:0.0:1787582820.020715:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8da5adf78a80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787582820.020722:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186228480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787582820.063990:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582820.064137:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162083840 00000100:00100000:1.0:1787582820.064149:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162083840 00000100:00100000:1.0:1787582820.064223:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 64 00000100:00100000:1.0:1787582820.064235:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+11:10444:x1874416162083840:12345-192.168.206.20@tcp:101:cat.0 00010000:00010000:1.0:1787582820.064264:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582820.064300:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b753811b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5806c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.064470:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b7538122 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.064489:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b7538122 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.064506:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b7538122 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582820.064518:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787582820.064809:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b753811b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5806c expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.064832:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b7538122 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5806c expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.064859:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:1.0:1787582820.064863:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787582820.064867:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7e00, rc 0) 00000100:00100000:1.0:1787582820.065200:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10444:x1874416162083840:12345-192.168.206.20@tcp:101:cat.0 Request processed in 966us (1223us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787582820.065210:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 64 00000100:00100000:3.0:1787582820.101243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582820.101370:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162083968 00000100:00100000:0.0:1787582820.101384:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162083968 00000100:00100000:0.0:1787582820.101471:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 65 00000100:00100000:0.0:1787582820.101492:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10445:x1874416162083968:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582820.101523:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582820.101551:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538130 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58073 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.101654:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538137 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.101671:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.101684:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582820.101967:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787582820.101972:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582820.102052:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.102093:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538130 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58073 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.102113:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58073 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.102124:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:0.0:1787582820.102127:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787582820.102131:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20efa00, rc 0) 00000100:00100000:0.0:1787582820.102228:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:10445:x1874416162083968:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 748us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582820.102236:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 65 00000100:00100000:2.0:1787582820.108205:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582820.108390:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162084352 00000100:00100000:3.0:1787582820.108403:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162084352 00000100:00100000:3.0:1787582820.108471:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 18 00000100:00100000:3.0:1787582820.108484:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:10445:x1874416162084352:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:2.0:1787582820.109857:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:10445:x1874416162084352:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 1364us (1654us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787582820.109871:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 18 00000100:00100000:1.0:1787582820.121369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582820.121561:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162084480 00000100:00100000:2.0:1787582820.121574:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162084480 00000100:00100000:2.0:1787582820.121659:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 5 00000100:00100000:2.0:1787582820.121682:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:10445:x1874416162084480:12345-192.168.206.20@tcp:103:lfs.0 00010000:00010000:2.0:1787582820.121702:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787582820.121734:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75380c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58057 expref: 15 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582820.121782:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b7538122 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5806c expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582820.121797:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7537fcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58018 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582820.121807:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da58533f400) 00010000:00010000:2.0:1787582820.121819:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582820.122028:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+12:10445:x1874416162084480:12345-192.168.206.20@tcp:103:lfs.0 Request processed in 358us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582820.122037:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 5 00000100:00100000:2.0:1787582820.127883:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582820.128028:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162084608 00000100:00100000:3.0:1787582820.128041:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162084608 00000100:00100000:3.0:1787582820.128118:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 66 00000100:00100000:3.0:1787582820.128130:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+12:10445:x1874416162084608:12345-192.168.206.20@tcp:58:lfs.0 00010000:00010000:3.0:1787582820.128349:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753813e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.128368:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753813e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.128380:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753813e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787582820.129106:0:5852:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787582820.129346:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787582820.129425:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1787582820.129565:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+12:10445:x1874416162084608:12345-192.168.206.20@tcp:58:lfs.0 Request processed in 1433us (1693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582820.129578:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 66 00000100:00100000:3.0:1787582820.158163:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582820.158433:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162084736 00000100:00100000:0.0:1787582820.158447:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162084736 00000100:00100000:0.0:1787582820.158527:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 67 00000100:00100000:0.0:1787582820.158540:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+12:10447:x1874416162084736:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582820.158567:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582820.158593:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538145 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5807a expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.158695:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b753814c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.158735:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b753814c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.158750:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b753814c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.158769:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538153 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.158776:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.158782:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160119:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b753815a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160139:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b753815a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160151:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b753815a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582820.160200:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787582820.160205:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582820.160228:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b753815a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160242:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b753815a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160252:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b753814c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160259:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b753814c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160290:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b753814c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160297:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20eee00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582820.160312:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b753814c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160358:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b753814c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160374:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:1.0:1787582820.160378:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582820.160383:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b753814c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160389:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b753814c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160414:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538153 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160421:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538153 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160428:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160433:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582820.160436:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538153 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160452:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538153 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160461:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da5a0b68500) 00010000:00010000:1.0:1787582820.160464:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582820.160467:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538153 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160474:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538153 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160517:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538145 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5807a expref: 14 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160534:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b753815a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5807a expref: 13 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.160542:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc800) 00010000:00010000:1.0:1787582820.160544:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787582820.160547:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6000, rc 0) 00000100:00100000:1.0:1787582820.160705:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10447:x1874416162084736:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 2166us (2554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582820.160716:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 67 00000100:00100000:3.0:1787582820.432666:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b35fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186228736:0@lo:400:kworker.0 00000100:00100000:2.0:1787582820.432765:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b35f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186228992:0@lo:400:kworker.0 00000100:00100000:2.0:1787582820.432859:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582820.432929:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787582820.432936:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186228608:0@lo:400:kworker.0 00000100:00100000:2.0:1787582820.432969:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582820.432995:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186229120:0@lo:400:kworker.0 00000100:00100000:2.0:1787582820.433020:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582820.433064:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186228608 00000100:00100000:2.0:1787582820.433072:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186228608 00000100:00100000:2.0:1787582820.433129:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787582820.433139:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3313:x1874416186228608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582820.433196:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3313:x1874416186228608:12345-0@lo:400:kworker.0 Request processed in 58us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582820.433218:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1787582820.433277:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b35f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186228608:0@lo:400:kworker.0 00000100:00100000:2.0:1787582820.433358:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186228864:0@lo:400:kworker.0 00000100:00100000:2.0:1787582820.433391:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582820.433427:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186228864 00000100:00100000:2.0:1787582820.433431:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186228864 00000100:00100000:2.0:1787582820.433462:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787582820.433469:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186228864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582820.433509:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186228864:12345-0@lo:400:kworker.0 Request processed in 40us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582820.433515:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787582820.433543:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b35e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186228864:0@lo:400:kworker.0 00000100:00100000:2.0:1787582820.433575:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186228992 00000100:00100000:2.0:1787582820.433579:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186228992 00000100:00100000:2.0:1787582820.433614:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186229120 00000100:00100000:2.0:1787582820.433618:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186229120 00000100:00100000:2.0:1787582820.433641:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787582820.433647:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186228992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582820.433700:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186228992:12345-0@lo:400:kworker.0 Request processed in 53us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582820.433706:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787582820.433719:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787582820.433725:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186229120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582820.433752:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186229120:12345-0@lo:400:kworker.0 Request processed in 28us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582820.433769:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1787582820.433788:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787582820.433813:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b35df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186229120:0@lo:400:kworker.0 00000100:00100000:2.0:1787582820.433825:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b35f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186228992:0@lo:400:kworker.0 00000100:00100000:3.0:1787582820.434088:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582820.434256:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186228736 00000100:00100000:0.0:1787582820.434261:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186228736 00000100:00100000:0.0:1787582820.434290:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787582820.434298:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186228736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582820.434366:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186228736:12345-0@lo:400:kworker.0 Request processed in 69us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582820.434373:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787582820.437076:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b35fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186228736:0@lo:400:kworker.0 00000040:00080000:2.0:1787582820.565773:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787582820.565785:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787582820.565861:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787582820.565869:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787582820.566014:0:11695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11695:1874416186229248:192.168.206.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787582820.566139:0:11695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a169b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787582820.571775:0:11695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11695:1874416186229248:192.168.206.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787582820.576572:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582820.576895:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162084864 00000100:00100000:3.0:1787582820.576908:0:5865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162084864 00000100:00100000:3.0:1787582820.577636:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 1 00000100:00100000:3.0:1787582820.577652:0:5865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10458:x1874416162084864:12345-192.168.206.20@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787582820.577773:0:5865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10458:x1874416162084864:12345-192.168.206.20@tcp:900:lhsmtool_posix.0 Request processed in 125us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582820.577781:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 1 00000100:00100000:2.0:1787582820.593193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582820.593545:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162084992 00000100:00100000:3.0:1787582820.593582:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162084992 00000100:00100000:3.0:1787582820.593696:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 68 00000100:00100000:3.0:1787582820.593710:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10458:x1874416162084992:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787582820.593765:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787582820.593923:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10458:x1874416162084992:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 Request processed in 216us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582820.593931:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 68 00000100:00100000:2.0:1787582820.602715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582820.602846:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162085120 00000100:00100000:3.0:1787582820.602859:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162085120 00000100:00100000:3.0:1787582820.602932:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 69 00000100:00100000:3.0:1787582820.602944:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10458:x1874416162085120:12345-192.168.206.20@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787582820.603037:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538161 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.603067:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538161 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.603080:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538161 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.603098:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7538168 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.603105:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7538168 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.603111:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7538168 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.603141:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753816f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.603166:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753816f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.603173:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753816f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582820.603219:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787582820.603224:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787582820.603242:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753816f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.603254:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538161 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.603262:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538161 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.603269:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538161 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.603275:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582820.603280:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538161 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.603287:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538161 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.603313:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8da5a0b68e00) 00010000:00010000:3.0:1787582820.604152:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582820.604161:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538161 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.604186:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538161 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.604207:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7538168 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.604214:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7538168 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.604221:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7538168 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.604227:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582820.604232:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7538168 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.604239:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7538168 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.604252:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8da583accb00) 00010000:00010000:3.0:1787582820.604256:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582820.604259:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7538168 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.604265:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b7538168 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.604282:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753816f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.604289:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753816f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.604952:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753816f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.604959:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582820.604962:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753816f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.604970:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753816f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.604981:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc800) 00010000:00010000:3.0:1787582820.604984:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582820.604988:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753816f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.604994:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753816f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582820.605218:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10458:x1874416162085120:12345-192.168.206.20@tcp:34:lhsmtool_posix.0 Request processed in 2269us (2509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582820.605230:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 69 00000100:00100000:3.0:1787582820.614991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582820.615164:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162085376 00000100:00100000:1.0:1787582820.615181:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162085376 00000100:00100000:1.0:1787582820.615290:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 70 00000100:00100000:1.0:1787582820.615313:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10458:x1874416162085376:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787582820.615479:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582820.615512:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538176 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58081 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.615661:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b753817d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.615680:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b753817d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.615694:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b753817d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582820.615707:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787582820.615827:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b753817d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.615835:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b753817d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.615841:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b753817d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.615846:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582820.615851:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b753817d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.615859:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b753817d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.615871:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc800) 00010000:00010000:1.0:1787582820.615880:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787582820.615885:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b753817d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.615891:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b753817d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.615952:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538176 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58081 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.615964:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8da5a0b68e00) 00010000:00010000:1.0:1787582820.615966:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787582820.615971:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538176 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58081 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.615980:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7200, rc 0) 00000100:00100000:1.0:1787582820.616080:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:10458:x1874416162085376:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 780us (1108us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1787582820.616089:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 70 00000100:00100000:3.0:1787582820.622299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582820.625669:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162085504 00000100:00100000:1.0:1787582820.625690:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162085504 00000100:00100000:1.0:1787582820.625776:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 71 00000100:00100000:1.0:1787582820.625789:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:10458:x1874416162085504:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787582820.625836:0:7653:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787582820.629210:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:10458:x1874416162085504:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 Request processed in 3409us (6910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582820.629227:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 71 00000100:00100000:2.0:1787582820.637248:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582820.637377:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162085760 00000100:00100000:1.0:1787582820.637398:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162085760 00000100:00100000:1.0:1787582820.637518:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 72 00000100:00100000:1.0:1787582820.637544:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:10458:x1874416162085760:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787582820.637572:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582820.637576:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787582820.637609:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538137 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58073 expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.637631:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:1.0:1787582820.637637:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787582820.637653:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b753818b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58088 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787582820.638493:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1787582820.638787:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538192 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.638803:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.638816:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.638879:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b753818b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58088 expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.638895:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58088 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.638914:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8da58533f800) 00010000:00010000:1.0:1787582820.638917:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582820.638920:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7600, rc 0) 00000100:00100000:1.0:1787582820.639007:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:10458:x1874416162085760:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 1467us (1768us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1787582820.639016:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 72 00000100:00100000:2.0:1787582820.642458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582820.643298:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162086016 00000100:00100000:0.0:1787582820.643341:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162086016 00000100:00100000:0.0:1787582820.643411:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 73 00000100:00100000:0.0:1787582820.643423:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:10458:x1874416162086016:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787582820.643516:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582820.643552:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538192 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58088 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.643579:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8da58533f800) 00010000:00010000:0.0:1787582820.643591:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787582820.643621:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.643636:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.643647:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.649637:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75381a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x43ca9720 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.649664:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75381a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x43ca9720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.649678:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75381a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x43ca9720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.650449:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.650461:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.650470:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.650477:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efe00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582820.650484:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.650501:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.650526:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:0.0:1787582820.650529:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582820.650596:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.650605:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.650632:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75381a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x43ca9720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.650641:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75381a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x43ca9720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.650648:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75381a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x43ca9720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.650656:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582820.650660:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75381a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x43ca9720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.650669:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75381a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x43ca9720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.650684:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x43ca9720 (ffff8da5a0b68d00) 00010000:00010000:0.0:1787582820.650687:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582820.650691:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75381a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x43ca9720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.650708:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75381a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x43ca9720 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582820.651692:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:10458:x1874416162086016:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 Request processed in 8259us (9234us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787582820.651709:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 73 00000100:00100000:2.0:1787582820.654839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582820.654920:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162086144 00000100:00100000:0.0:1787582820.654934:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162086144 00000100:00100000:0.0:1787582820.655016:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 74 00000100:00100000:0.0:1787582820.655030:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:10458:x1874416162086144:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787582820.655224:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582820.655254:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b75381ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5808f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.655291:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75381b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.655315:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75381b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.655350:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75381b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.655449:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b75381ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5808f expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.655469:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75381b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5808f expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.655490:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8da5a0b68100) 00010000:00010000:0.0:1787582820.655493:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787582820.655496:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20efa00, rc 0) 00000100:00100000:0.0:1787582820.655567:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:10458:x1874416162086144:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 541us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582820.655576:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 74 00000100:00100000:0.0:1787582820.659018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582820.659167:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162086400 00000100:00100000:1.0:1787582820.659183:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162086400 00000100:00100000:1.0:1787582820.659261:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 75 00000100:00100000:1.0:1787582820.659357:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:10458:x1874416162086400:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787582820.659882:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b75381bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.659904:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b75381bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.659918:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b75381bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787582820.660532:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1787582820.660547:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361667228689ns, next at 362667225442ns, rc = 0 00000004:00010000:1.0:1787582820.660653:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000985a91e5 reply state 0000000075ee7d70 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b75381bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582820.660664:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787582820.662029:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+17:10458:x1874416162086400:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 Request processed in 2749us (3009us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1787582820.662057:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 75 00010000:00010000:0.0:1787582820.668579:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b75381bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.668712:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b75381bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.668722:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b75381bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.668729:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582820.668734:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b75381bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.668743:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b75381bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.668765:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8da5a0b68100) 00010000:00010000:0.0:1787582820.668769:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787582820.668774:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b75381bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.668781:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b75381bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582820.669023:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582820.669888:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162086528 00000100:00100000:1.0:1787582820.669905:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162086528 00000100:00100000:1.0:1787582820.669979:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 76 00000100:00100000:1.0:1787582820.669993:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+16:10458:x1874416162086528:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787582820.670029:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582820.670120:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75381c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58096 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.670199:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75381c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58096 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.670405:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75381c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58096 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.670431:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8da5a0b68100) 00010000:00010000:1.0:1787582820.670435:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787582820.670438:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6a00, rc 0) 00000100:00100000:1.0:1787582820.670518:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+17:10458:x1874416162086528:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 529us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582820.670527:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 76 00000100:00100000:3.0:1787582820.675550:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582820.675649:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162086656 00000100:00100000:1.0:1787582820.675662:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162086656 00000100:00100000:1.0:1787582820.675740:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 26 00000100:00100000:1.0:1787582820.675749:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1874416162086656:12345-192.168.206.20@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1787582820.675786:0:8218:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp t0 exp 0000000000000000 cur 361 last 0 00000020:00000080:1.0:1787582820.675833:0:8218:0:(genops.c:1385:class_connect()) connect: client 730f9f4f-46d8-441e-9162-5fde1074d6a5, cookie 0xa113d808b75381ca 00002000:00100000:1.0:1787582820.675848:0:8218:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 730f9f4f-46d8-441e-9162-5fde1074d6a5/ffff8da5bb7f7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787582820.675862:0:8218:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787582820.676622:0:8218:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787582820.676662:0:8218:0:(import.c:65:import_set_state_nolock()) ffff8da5bb7f1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582820.676749:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2356:x1874416162086656:12345-192.168.206.20@tcp:8:lhsmtool_posix.0 Request processed in 998us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582820.676759:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 26 00000100:00100000:3.0:1787582820.679470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582820.682640:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162086784 00000100:00100000:1.0:1787582820.682659:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162086784 00000100:00100000:1.0:1787582820.682760:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 27 00000100:00100000:1.0:1787582820.682774:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:0:x1874416162086784:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787582820.682785:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1787582820.731192:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1787582820.731211:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 730f9f4f-46d8-441e-9162-5fde1074d6a5 00000100:00100000:1.0:1787582820.731244:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:0:x1874416162086784:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 Request processed in 48466us (51781us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787582820.731258:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 27 00000100:00100000:0.0:1787582820.735002:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582820.735154:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162087040 00000100:00100000:3.0:1787582820.735168:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162087040 00000100:00100000:3.0:1787582820.735235:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 19 00000100:00100000:3.0:1787582820.735255:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+17:10458:x1874416162087040:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787582820.735593:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:10458:x1874416162087040:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 Request processed in 339us (602us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787582820.735602:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 19 00000100:00100000:2.0:1787582820.738813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582820.738918:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162087296 00000100:00100000:0.0:1787582820.738931:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162087296 00000100:00100000:0.0:1787582820.739007:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 77 00000100:00100000:0.0:1787582820.739019:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:10458:x1874416162087296:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787582820.739228:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:10458:x1874416162087296:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 210us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582820.739236:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 77 00000100:00100000:3.0:1787582820.741269:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582820.741681:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162087424 00000100:00100000:0.0:1787582820.741693:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162087424 00000100:00100000:0.0:1787582820.741780:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 78 00000100:00100000:0.0:1787582820.741792:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:10458:x1874416162087424:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787582820.741817:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582820.741842:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75381d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5809d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.741919:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.741935:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.741947:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582820.742005:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582820.742024:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.742156:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75381d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5809d expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.742178:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5809d expref: 19 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.742187:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8da5a0b68100) 00010000:00010000:0.0:1787582820.742191:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787582820.742195:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20efe00, rc 0) 00000100:00100000:0.0:1787582820.742348:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:10458:x1874416162087424:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 529us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582820.742357:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 78 00000100:00100000:2.0:1787582820.748027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582820.748185:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162087552 00000100:00100000:3.0:1787582820.748199:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162087552 00000100:00100000:3.0:1787582820.748335:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 28 00000100:00100000:3.0:1787582820.748347:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162087552:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787582820.748370:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582820.748396:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b75381df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d580a4 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787582820.748444:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c5965, blocks: 0x1 00010000:00010000:3.0:1787582820.748467:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1787582820.748471:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582820.748482:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b75381df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580a4 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.748503:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b75381df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580a4 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.748518:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1600, rc 0) 00000100:00100000:3.0:1787582820.748581:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162087552:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 235us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582820.748606:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 28 00000100:00100000:2.0:1787582820.751219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582820.751346:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162087808 00000100:00100000:3.0:1787582820.751358:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162087808 00000100:00100000:2.0:1787582820.751554:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 79 00000100:00100000:2.0:1787582820.751567:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:10458:x1874416162087808:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787582820.751690:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:10458:x1874416162087808:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 124us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582820.751706:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 79 00000100:00100000:0.0:1787582820.756229:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582820.756897:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162087936 00000100:00100000:3.0:1787582820.756911:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162087936 00000100:00100000:3.0:1787582820.757035:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 29 00000100:00100000:3.0:1787582820.757047:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:10458:x1874416162087936:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787582820.757072:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582820.757094:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b75381e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d580ab expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.757133:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b75381df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580a4 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.757142:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582820.757148:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582820.757153:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b75381e6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ab expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.757197:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b75381df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580a4 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.757290:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b75381df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580a4 expref: 7 pid: 6704 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582820.757342:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b35df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1874416186229376:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582820.757471:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c780 going to sleep for 11 seconds 00000100:00100000:1.0:1787582820.759446:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b35df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1874416186229376:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582820.759488:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b75381e6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ab expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582820.759512:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0800, rc 0) 00000100:00100000:1.0:1787582820.759570:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:10458:x1874416162087936:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 2525us (3352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582820.759581:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 29 00000100:00100000:0.0:1787582820.762224:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582820.762347:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162088064 00000100:00100000:3.0:1787582820.762360:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162088064 00010000:00010000:3.0:1787582820.762411:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b75381df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580a4 expref: 7 pid: 6704 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582820.762460:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 42 00000100:00100000:3.0:1787582820.762471:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5911a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2359:x1874416162088064:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582820.762488:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582820.762515:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b75381df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580a4 expref: 7 pid: 6704 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.762537:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b75381df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580a4 expref: 7 pid: 6704 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.762567:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b75381df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580a4 expref: 7 pid: 6704 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.762583:0:5840:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582820.762588:0:5840:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582820.762598:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b75381e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ab expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.762609:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b75381e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ab expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.762667:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b75381e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ab expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582820.762685:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b35e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5840:1874416186229504:192.168.206.20@tcp:105: 00000100:00100000:3.0:1787582820.762783:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582820.765799:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b35e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5840:1874416186229504:192.168.206.20@tcp:105: 00010000:00010000:3.0:1787582820.765831:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582820.766015:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5911a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162088064:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 3543us (3804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582820.766027:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 42 00000100:00100000:3.0:1787582820.769135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582820.769386:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162088192 00000100:00100000:0.0:1787582820.769398:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162088192 00002000:00100000:0.0:1787582820.769459:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8da58b35d880 x1874416162088192/t0(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:286/0 lens 504/0 e 0 to 0 dl 1787582831 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787582820.769473:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da58b35d880 with x1874416162088192 ext(0->8) 00002000:00010000:0.0:1787582820.769480:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da58b35d880 00000100:00100000:0.0:1787582820.769519:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 0 00000100:00100000:0.0:1787582820.769534:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2360:x1874416162088192:12345-192.168.206.20@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787582820.776090:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2360:x1874416162088192:12345-192.168.206.20@tcp:4:lhsmtool_posix.0 Request processed in 6553us (6959us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787582820.776104:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 0 00002000:00100000:0.0:1787582820.776119:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8da58b35d880 x1874416162088192/t4294967302(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:286/0 lens 504/448 e 0 to 0 dl 1787582831 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787582820.776132:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da58b35d880 with x1874416162088192 ext(0->8) 00002000:00010000:0.0:1787582820.776141:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da58b35d880 00000100:00100000:0.0:1787582820.779066:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582820.779489:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162088320 00000100:00100000:2.0:1787582820.779507:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162088320 00000100:00100000:2.0:1787582820.779583:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 80 00000100:00100000:2.0:1787582820.779596:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:10458:x1874416162088320:12345-192.168.206.20@tcp:44:lhsmtool_posix.0 00010000:00010000:2.0:1787582820.816577:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787582820.854875:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1787582820.854896:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787582820.854932:0:5876:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1787582820.854944:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:3.0:1787582820.855431:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186229632:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787582820.855519:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582820.855719:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10458:x1874416162088320:12345-192.168.206.20@tcp:44:lhsmtool_posix.0 Request processed in 76121us (76656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582820.855732:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 80 00000020:00080000:2.0:1787582820.855773:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787582820.856209:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787582820.856231:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186229632 00000100:00100000:2.0:1787582820.856240:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186229632 00000100:00100000:2.0:1787582820.856331:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787582820.856341:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186229632:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787582820.856544:0:8218:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787582820.856560:0:8218:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787582821 00002000:00010000:2.0:1787582820.856563:0:8218:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787582820.856565:0:8218:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787582821 -> 1787582821 00002000:00010000:2.0:1787582820.856568:0:8218:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787582820.856618:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1874416186229632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 277us (1098us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787582820.856624:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:2.0:1787582820.856799:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8da483513800/2, rc 0, transno 4294967303 00000100:00100000:2.0:1787582820.856806:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186229632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787582820.862864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582820.863007:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162088448 00000100:00100000:0.0:1787582820.863021:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162088448 00000100:00100000:0.0:1787582820.863094:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 31 00000100:00100000:0.0:1787582820.863107:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2357:x1874416162088448:12345-192.168.206.20@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787582820.935540:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1787582820.935736:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2357:x1874416162088448:12345-192.168.206.20@tcp:16:lhsmtool_posix.0 Request processed in 72620us (72876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582820.935766:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 31 00000001:00080000:0.0:1787582820.935857:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1787582820.944750:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787582820.944780:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186229760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582820.944870:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582820.944947:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186229760 00000100:00100000:2.0:1787582820.944955:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186229760 00000100:00100000:2.0:1787582820.945015:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787582820.945025:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874416186229760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787582820.945083:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582820.945135:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874416186229760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582820.945142:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787582820.945200:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186229760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787582820.947518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582820.950452:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162088704 00000100:00100000:2.0:1787582820.950473:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162088704 00000100:00100000:3.0:1787582820.952790:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 81 00000100:00100000:3.0:1787582820.952808:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10458:x1874416162088704:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787582820.952883:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582820.952919:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75381d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5809d expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.952944:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8da5a0b68100) 00010000:00010000:3.0:1787582820.952950:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787582820.952990:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75381ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.953012:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75381ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.953024:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75381ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787582820.954021:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002036d873 reply state 00000000f0e7484a transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75381ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582820.954039:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787582820.954454:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:10458:x1874416162088704:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 Request processed in 1499us (6798us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787582820.954466:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 81 00010000:00010000:3.0:1787582820.956712:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75381ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.956735:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75381ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.956745:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75381ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.956752:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582820.956757:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75381ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.956765:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75381ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.956787:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8da5a0b68100) 00010000:00010000:3.0:1787582820.956791:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582820.956796:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75381ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.956802:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75381ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582820.957558:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582820.957703:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162088832 00000100:00100000:2.0:1787582820.957716:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162088832 00000100:00100000:2.0:1787582820.957782:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 32 00000100:00100000:2.0:1787582820.957795:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2360:x1874416162088832:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787582820.958118:0:8218:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787582820.958122:0:8218:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787582821 -> 1787582820 00002000:00010000:2.0:1787582820.958125:0:8218:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787582818 00002000:00010000:2.0:1787582820.958127:0:8218:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787582821 -> 1787582820 00002000:00010000:2.0:1787582820.958130:0:8218:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787582820.958200:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2360:x1874416162088832:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 Request processed in 407us (658us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787582820.958220:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 32 00000100:00100000:2.0:1787582820.961789:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582820.961881:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162089088 00000100:00100000:0.0:1787582820.961900:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162089088 00000100:00100000:0.0:1787582820.961967:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 82 00000100:00100000:0.0:1787582820.961979:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10458:x1874416162089088:12345-192.168.206.20@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787582820.962072:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75381f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.962093:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75381b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5808f expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.962102:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75381f4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.962146:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75381b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5808f expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582820.962162:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75381b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5808f expref: 13 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582820.962179:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483512a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1874416186229888:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582820.962296:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b51f03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582820.979746:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582820.979784:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162089216 00000100:00100000:2.0:1787582820.979796:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162089216 00010000:00010000:2.0:1787582820.979846:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75381b5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5808f expref: 14 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582820.979890:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 43 00000100:00100000:2.0:1787582820.979901:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:2359:x1874416162089216:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582820.979933:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582820.979941:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75381b5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5808f expref: 14 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582820.979958:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75381b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5808f expref: 14 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582820.979987:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8da5a0b68100) 00010000:00010000:2.0:1787582820.979993:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75381f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582820.980004:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75381f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582820.980013:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75381f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582820.980035:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582820.980226:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:2359:x1874416162089216:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 325us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582820.980234:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 43 00010000:00010000:3.0:1787582820.981107:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75381b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5808f expref: 13 pid: 5852 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582820.981130:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483512a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1874416186229888:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582820.981158:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75381f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.981170:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75381f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.981176:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75381f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.981211:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75381f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.981219:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75381f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.981227:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75381f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.981232:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582820.981237:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75381f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.981245:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75381f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.981259:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8da5a0b68100) 00010000:00010000:3.0:1787582820.981263:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787582820.981286:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75381f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.981293:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75381f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582820.981403:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+12:10458:x1874416162089088:12345-192.168.206.20@tcp:55:lhsmtool_posix.0 Request processed in 19425us (19627us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787582820.981413:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 82 00000100:00100000:0.0:1787582820.992831:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582820.992906:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162089344 00000100:00100000:3.0:1787582820.992919:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162089344 00000100:00100000:3.0:1787582820.993014:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 33 00000100:00100000:3.0:1787582820.993025:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2360:x1874416162089344:12345-192.168.206.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787582820.993092:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ce2c7b5b/0xa113d808b75381fb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.993117:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b75381e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ab expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.993127:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582820.993131:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787582820.993136:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce2c7b5b/0xa113d808b75381fb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.993180:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b75381e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ab expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582820.993198:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b75381e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ab expref: 7 pid: 6705 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582820.993224:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1874416186230016:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582820.993462:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582820.999857:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582820.999930:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162089472 00000100:00100000:1.0:1787582820.999942:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162089472 00010000:00010000:1.0:1787582820.999995:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b75381e6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ab expref: 8 pid: 6705 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582821.000053:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 44 00000100:00100000:1.0:1787582821.000065:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2359:x1874416162089472:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582821.000082:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582821.000112:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b75381e6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ab expref: 8 pid: 6705 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582821.000131:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b75381e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ab expref: 8 pid: 6705 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582821.000164:0:5839:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1787582821.000170:0:5839:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787582821.000177:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce2c7b5b/0xa113d808b75381fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582821.000188:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce2c7b5b/0xa113d808b75381fb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582821.000215:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582821.001331:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2359:x1874416162089472:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 1234us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582821.001362:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 44 00010000:00010000:0.0:1787582821.001976:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b75381e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ab expref: 7 pid: 6705 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582821.002001:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1874416186230016:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582821.002030:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ce2c7b5b/0xa113d808b75381fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.002118:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ce2c7b5b/0xa113d808b75381fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.002127:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce2c7b5b/0xa113d808b75381fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.002168:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ce2c7b5b/0xa113d808b75381fb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.002177:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce2c7b5b/0xa113d808b75381fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.002186:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce2c7b5b/0xa113d808b75381fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.002192:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1000 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582821.002198:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce2c7b5b/0xa113d808b75381fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.002207:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce2c7b5b/0xa113d808b75381fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.002231:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce2c7b5b/0xa113d808b75381fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.002250:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce2c7b5b/0xa113d808b75381fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582821.005864:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483511880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2360:x1874416162089344:12345-192.168.206.20@tcp:1:lhsmtool_posix.0 Request processed in 12825us (13030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582821.005881:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 33 00000100:00100000:2.0:1787582821.016252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582821.016479:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162089728 00000100:00100000:2.0:1787582821.016491:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162089728 00000100:00080000:0.0:1787582821.016846:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787582821.017153:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 83 00000100:00100000:2.0:1787582821.017169:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+12:10458:x1874416162089728:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787582821.017450:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538202 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582821.017472:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538202 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582821.017487:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538202 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582821.018019:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538209 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582821.018037:0:7653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75381c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58096 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582821.019777:0:7653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538209 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582821.019838:0:7653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75381c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58096 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582821.019873:0:7653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75381c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58096 expref: 13 pid: 5854 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582821.019892:0:7653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1874416186230144:192.168.206.20@tcp:104: 00000100:00100000:2.0:1787582821.020010:0:7653:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da582d6c780 going to sleep for 11 seconds 00000100:00100000:3.0:1787582821.025361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582821.026472:0:7653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1874416186230144:192.168.206.20@tcp:104: 00010000:00010000:2.0:1787582821.026511:0:7653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538209 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582821.026876:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162089856 00000100:00100000:2.0:1787582821.026885:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162089856 00010000:00010000:2.0:1787582821.026930:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75381c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58096 expref: 14 pid: 5854 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582821.027278:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 45 00000100:00100000:2.0:1787582821.027292:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:2360:x1874416162089856:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582821.027338:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582821.027347:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75381c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58096 expref: 14 pid: 5854 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582821.027363:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75381c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58096 expref: 14 pid: 5854 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582821.027390:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75381c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58096 expref: 14 pid: 5854 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582821.027418:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8da5a0b68100) 00010000:00010000:2.0:1787582821.027423:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538209 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582821.027433:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538209 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582821.027441:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538209 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582821.027468:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582821.027535:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:2360:x1874416162089856:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 246us (2191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582821.027543:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 45 00010000:00010000:3.0:1787582821.035428:0:7653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538209 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.035450:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538209 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787582821.035711:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1787582821.035893:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1787582821.035942:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1787582821.036223:0:7653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7653:1874416186230272:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787582821.036358:0:7653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582821.036409:0:7653:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c000 going to sleep for 11 seconds 00000100:00100000:0.0:1787582821.038214:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186230272 00000100:00100000:0.0:1787582821.038234:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186230272 00000100:00100000:0.0:1787582821.038352:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787582821.038364:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7653:x1874416186230272:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787582821.038517:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7653:x1874416186230272:12345-0@lo:1000:mdt00_003.0 Request processed in 155us (2158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582821.038525:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787582821.038692:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582821.038858:0:7653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787582821.038866:0:7653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8da483513800, transno 4294967303 00000100:00100000:3.0:1787582821.038888:0:7653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7653:1874416186230272:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787582821.044812:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787582821.044943:0:7653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7653:1874416186230400:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787582821.046237:0:7653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582821.046654:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186230400 00000100:00100000:2.0:1787582821.046667:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186230400 00000100:00100000:2.0:1787582821.046739:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787582821.046751:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7653:x1874416186230400:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787582821.049237:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7653:x1874416186230400:12345-0@lo:1000:mdt00_003.0 Request processed in 2475us (4180us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787582821.049254:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:0.0:1787582821.052519:0:12016:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787582821.052532:0:12016:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787582821.052802:0:12016:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787582821.052810:0:12016:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787582821.054173:0:7653:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5884a7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787582821.054245:0:7653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7653:1874416186230400:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787582821.057964:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538209 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058018:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538209 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058026:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538209 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058033:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9e200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582821.058050:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538209 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058059:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538209 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058081:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8da5a0b68100) 00010000:00010000:3.0:1787582821.058085:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787582821.058090:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538209 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058097:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538209 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058161:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753813e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058169:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753813e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058175:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753813e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058180:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582821.058191:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753813e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058198:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753813e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058207:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc800) 00010000:00010000:3.0:1787582821.058210:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787582821.058213:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753813e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058219:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753813e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058251:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b7538210 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058270:0:7653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b753815a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5807a expref: 16 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058279:0:7653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b7538210 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058370:0:7653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b753815a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5807a expref: 16 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.058394:0:7653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b753815a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5807a expref: 16 pid: 7653 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582821.058413:0:7653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1874416186230528:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582821.058536:0:7653:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1787582821.061157:0:7653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1874416186230528:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582821.061194:0:7653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b7538210 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582821.061905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582821.061984:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162089984 00000100:00100000:3.0:1787582821.061993:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162089984 00010000:00010000:3.0:1787582821.062042:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b753815a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5807a expref: 17 pid: 7653 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582821.062127:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 46 00000100:00100000:3.0:1787582821.062139:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+17:2359:x1874416162089984:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582821.062158:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582821.062166:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b753815a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5807a expref: 17 pid: 7653 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.062182:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b753815a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5807a expref: 17 pid: 7653 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.062208:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b753815a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5807a expref: 17 pid: 7653 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.062227:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc800) 00010000:00010000:3.0:1787582821.062232:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b7538210 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.062243:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b7538210 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.062251:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b7538210 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582821.062284:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582821.062381:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+16:2359:x1874416162089984:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 243us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582821.062402:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 46 00010000:00010000:0.0:1787582821.062578:0:7653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b7538210 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.062599:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b7538210 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.062613:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b7538210 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.062620:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b7538210 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.062628:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b7538210 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.062634:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582821.062640:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b7538210 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.062648:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b7538210 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.062659:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc800) 00010000:00010000:0.0:1787582821.062663:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582821.062667:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b7538210 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.062673:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b7538210 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.062688:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538202 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.062695:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538202 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.062707:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538202 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.062713:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9fa00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582821.062716:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538202 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.062723:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538202 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.062849:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc800) 00010000:00010000:0.0:1787582821.062852:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787582821.062856:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538202 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582821.062862:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538202 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582821.063122:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:10458:x1874416162089728:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 45956us (46880us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787582821.063132:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 83 00000020:00080000:0.0:1787582821.063137:0:7653:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787582821.063471:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787582821.063477:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787582821.063507:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787582821.063513:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787582821.065780:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582821.065909:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162090240 00000100:00100000:1.0:1787582821.065922:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162090240 00000100:00100000:1.0:1787582821.065986:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:1.0:1787582821.065998:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:10458:x1874416162090240:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787582821.066919:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787582821.067043:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1787582821.067103:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538217 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582821.067124:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538217 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582821.067136:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538217 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582821.067146:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538217 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582821.067153:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538217 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582821.067161:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538217 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582821.067190:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787582821.067350:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+17:10458:x1874416162090240:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 Request processed in 1323us (1547us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787582821.067360:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 20 00000020:00080000:1.0:1787582821.067375:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787582821.067413:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582821.067421:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538217 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582821.067428:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6e00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:1.0:1787582821.067432:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538217 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582821.067441:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538217 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582821.067456:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8da58533f600) 00010000:00010000:1.0:1787582821.067460:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787582821.067464:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538217 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582821.067469:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538217 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582821.067489:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582821.067491:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582821.067493:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582821.844253:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582822.864558:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787582823.079585:0:12068:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787582823.079598:0:12068:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787582823.079641:0:12068:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787582823.079649:0:12068:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787582823.212780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582823.212886:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162090496 00000100:00100000:2.0:1787582823.212898:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162090496 00000100:00100000:2.0:1787582823.216029:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 84 00000100:00100000:2.0:1787582823.216048:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+17:10476:x1874416162090496:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582823.216081:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582823.216108:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f200/0xa113d808b753821e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d580b2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.216450:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7538225 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.216467:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7538225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.216483:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7538225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582823.216497:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787582823.216690:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f200/0xa113d808b753821e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580b2 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.216708:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7538225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580b2 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.216717:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:2.0:1787582823.216720:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787582823.216724:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9fc00, rc 0) 00000100:00100000:2.0:1787582823.216811:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:10476:x1874416162090496:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 769us (4046us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1787582823.216828:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 84 00000100:00080000:0.0:1787582823.217811:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582823.221537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582823.221674:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162090624 00000100:00100000:0.0:1787582823.221688:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162090624 00000100:00100000:0.0:1787582823.221787:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 85 00000100:00100000:0.0:1787582823.221798:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:10476:x1874416162090624:12345-192.168.206.20@tcp:34:lfs.0 00010000:00010000:0.0:1787582823.221900:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538233 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.221920:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538233 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.221933:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538233 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.221950:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753823a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.221958:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753823a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.221964:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753823a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222576:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538241 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222588:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222596:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787582823.222649:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222665:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538233 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222680:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538233 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222688:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538233 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222695:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582823.222701:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538233 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222710:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538233 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222725:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:0.0:1787582823.222729:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582823.222735:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538233 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222741:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538233 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222753:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753823a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222759:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753823a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222766:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753823a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222771:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ef800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582823.222780:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753823a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222787:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753823a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222795:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da5a0b68400) 00010000:00010000:0.0:1787582823.222798:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582823.222801:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753823a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222808:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753823a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222824:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222831:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538241 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222837:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538241 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222842:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582823.222845:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538241 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222852:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538241 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222859:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da5a0b68800) 00010000:00010000:0.0:1787582823.222862:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582823.222870:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538241 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.222875:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538241 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582823.223021:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:10476:x1874416162090624:12345-192.168.206.20@tcp:34:lfs.0 Request processed in 1221us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582823.223030:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 85 00000100:00100000:1.0:1787582823.280929:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582823.281067:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162090880 00000100:00100000:3.0:1787582823.281081:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162090880 00000100:00100000:3.0:1787582823.281228:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 86 00000100:00100000:3.0:1787582823.281241:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:10479:x1874416162090880:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:3.0:1787582823.281267:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582823.281303:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538248 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d580b9 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.281794:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b753824f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.281811:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b753824f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.281824:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b753824f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.281839:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538256 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.281845:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.281851:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283581:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753825d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283603:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753825d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283616:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753825d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582823.283630:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787582823.283752:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b753824f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283764:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b753824f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283847:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b753824f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283853:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582823.283858:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b753824f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283866:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b753824f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283880:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:3.0:1787582823.283883:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582823.283888:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b753824f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283906:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b753824f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283918:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283923:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538256 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283929:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283934:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582823.283937:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283942:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538256 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283949:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da583acc100) 00010000:00010000:3.0:1787582823.283951:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582823.283954:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538256 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.283959:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538256 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.284085:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538248 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580b9 expref: 22 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.284100:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753825d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580b9 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.284189:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc900) 00010000:00010000:3.0:1787582823.284193:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787582823.284195:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1400, rc 0) 00000100:00100000:3.0:1787582823.284281:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+21:10479:x1874416162090880:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 3041us (3365us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1787582823.284304:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 86 00000100:00100000:1.0:1787582823.287168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582823.287366:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162091008 00000100:00100000:3.0:1787582823.287379:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162091008 00000100:00100000:3.0:1787582823.287516:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 87 00000100:00100000:3.0:1787582823.287528:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+21:10479:x1874416162091008:12345-192.168.206.20@tcp:54:lfs.0 00010000:00010000:3.0:1787582823.287616:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b753826b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.287636:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b753826b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.287648:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b753826b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.287678:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b753826b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.287685:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b753826b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.287692:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b753826b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.287697:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582823.287708:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b753826b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.287716:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b753826b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.287730:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc900) 00010000:00010000:3.0:1787582823.287734:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787582823.287738:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b753826b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.287746:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b753826b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582823.287821:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+21:10479:x1874416162091008:12345-192.168.206.20@tcp:54:lfs.0 Request processed in 295us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582823.287828:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 87 00000100:00100000:3.0:1787582823.290160:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582823.290233:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162091264 00000100:00100000:0.0:1787582823.290245:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162091264 00000100:00100000:0.0:1787582823.290348:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 21 00000100:00100000:0.0:1787582823.290359:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583664050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+21:10479:x1874416162091264:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:0.0:1787582823.290720:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583664050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+22:10479:x1874416162091264:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 362us (572us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787582823.290728:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 21 00000100:00100000:1.0:1787582823.336824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582823.336933:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162091520 00000100:00100000:3.0:1787582823.336945:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162091520 00000100:00100000:3.0:1787582823.337024:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 88 00000100:00100000:3.0:1787582823.337045:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+22:9997:x1874416162091520:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:3.0:1787582823.337079:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582823.337106:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7538272 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d580c0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.337240:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.337258:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753825d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580b9 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.337308:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.337538:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753825d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580b9 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.337555:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753825d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580b9 expref: 23 pid: 5852 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582823.337571:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1874416186230656:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582823.337803:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fd0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582823.340770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582823.340879:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162091648 00000100:00100000:2.0:1787582823.340891:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162091648 00010000:00010000:2.0:1787582823.340944:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753825d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580b9 expref: 24 pid: 5852 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582823.340998:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 47 00000100:00100000:2.0:1787582823.341009:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+24:2359:x1874416162091648:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582823.341026:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582823.341035:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753825d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580b9 expref: 24 pid: 5852 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.341052:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753825d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580b9 expref: 24 pid: 5852 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.341082:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc900) 00010000:00010000:2.0:1787582823.341087:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.341098:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.341107:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.341130:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582823.341207:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483513800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+24:2359:x1874416162091648:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 199us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582823.341236:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 47 00010000:00010000:3.0:1787582823.342618:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753825d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580b9 expref: 23 pid: 5852 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582823.342646:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1874416186230656:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582823.342675:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.342688:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.342694:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582823.342718:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787582823.342915:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7538272 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580c0 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.342950:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580c0 expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.342961:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc900) 00010000:00010000:3.0:1787582823.342964:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787582823.342968:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0200, rc 0) 00000100:00100000:3.0:1787582823.343659:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+23:9997:x1874416162091520:12345-192.168.206.20@tcp:101:bash.0 Request processed in 6621us (6846us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787582823.343670:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 88 00000100:00100000:0.0:1787582823.346548:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582823.346657:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162091904 00000100:00100000:3.0:1787582823.346670:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162091904 00000100:00100000:3.0:1787582823.346740:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 89 00000100:00100000:3.0:1787582823.346753:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+23:9997:x1874416162091904:12345-192.168.206.20@tcp:36:bash.0 00010000:00010000:3.0:1787582823.347091:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538287 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.347114:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538287 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.347129:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538287 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787582823.347510:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787582823.347545:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba9caebd reply state 00000000b62d1c45 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538287 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582823.347555:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787582823.347629:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787582823.347809:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+27:9997:x1874416162091904:12345-192.168.206.20@tcp:36:bash.0 Request processed in 1057us (1274us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787582823.347818:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 89 00000020:00080000:3.0:1787582823.347825:0:7653:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787582823.357068:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538287 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.357093:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538287 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.357101:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538287 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.357108:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582823.357113:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538287 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.357144:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538287 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.357167:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc900) 00010000:00010000:0.0:1787582823.357171:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582823.357177:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538287 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.357184:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538287 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582823.359166:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582823.359299:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162092032 00000100:00100000:2.0:1787582823.359312:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162092032 00000100:00100000:2.0:1787582823.359896:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 90 00000100:00100000:2.0:1787582823.359908:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:9997:x1874416162092032:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:2.0:1787582823.359941:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582823.359968:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b753828e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d580c7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.360046:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b753828e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580c7 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.360063:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b753828e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580c7 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.360086:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc900) 00010000:00010000:2.0:1787582823.360089:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787582823.360093:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9e600, rc 0) 00000100:00100000:2.0:1787582823.360171:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+27:9997:x1874416162092032:12345-192.168.206.20@tcp:101:bash.0 Request processed in 265us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582823.360561:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 90 00000100:00100000:1.0:1787582823.363769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582823.363855:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162092160 00000100:00100000:2.0:1787582823.363868:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162092160 00000100:00080000:0.0:1787582823.363943:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787582823.363970:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 34 00000100:00100000:2.0:1787582823.363984:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58303d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:9997:x1874416162092160:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:2.0:1787582823.364008:0:8218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582823.364059:0:8218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032ba3946/0xa113d808b7538295 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d580ce expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787582823.364097:0:8218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c5964, atime: 0x6a8c5962, ctime: 0x6a8c5964, blocks: 0xb 00010000:00010000:2.0:1787582823.364125:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1787582823.364130:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787582823.364140:0:8218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032ba3946/0xa113d808b7538295 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ce expref: 7 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.364163:0:8218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032ba3946/0xa113d808b7538295 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ce expref: 7 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.364250:0:8218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9fa00, rc 0) 00000100:00100000:2.0:1787582823.364395:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58303d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:9997:x1874416162092160:12345-192.168.206.20@tcp:101:bash.0 Request processed in 412us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582823.364404:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 34 00000100:00100000:1.0:1787582823.367950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582823.370102:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162092288 00000100:00100000:2.0:1787582823.370122:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162092288 00002000:00010000:2.0:1787582823.370198:0:6708:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787582823.370204:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5b4fa0a80 with x1874416162092288 ext(0->18446744073709551615) 00002000:00010000:2.0:1787582823.370220:0:6708:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da5b4fa0a80. 00000100:00100000:2.0:1787582823.370273:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 1 00000100:00100000:2.0:1787582823.370295:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2360:x1874416162092288:12345-192.168.206.20@tcp:10:bash.0 00002000:00010000:2.0:1787582823.370722:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787582823.370727:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787582820 -> 1787582823 00002000:00010000:2.0:1787582823.370730:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787582818 -> 1787582818 00002000:00010000:2.0:1787582823.370748:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787582820 -> 1787582823 00002000:00010000:2.0:1787582823.370751:0:6708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787582823.370831:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2360:x1874416162092288:12345-192.168.206.20@tcp:10:bash.0 Request processed in 546us (2893us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787582823.370840:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 1 00002000:00010000:2.0:1787582823.370844:0:6708:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1787582823.370847:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5b4fa0a80 with x1874416162092288 ext(0->18446744073709551615) 00002000:00010000:2.0:1787582823.370852:0:6708:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da5b4fa0a80. 00000100:00100000:0.0:1787582823.453628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582823.454004:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162092416 00000100:00100000:1.0:1787582823.454018:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162092416 00000100:00100000:1.0:1787582823.454101:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 91 00000100:00100000:1.0:1787582823.454131:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+27:10493:x1874416162092416:12345-192.168.206.20@tcp:34:lfs.0 00010000:00010000:1.0:1787582823.454234:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753829c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.454255:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753829c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.454269:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753829c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.454297:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b75382a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.454305:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b75382a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.454312:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b75382a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.454997:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455009:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455016:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787582823.455426:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455441:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753829c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455456:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753829c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455463:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753829c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455470:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582823.455662:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753829c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455673:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753829c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455689:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:1.0:1787582823.455692:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582823.455698:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753829c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455705:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753829c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455723:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b75382a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455728:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b75382a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455735:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b75382a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455740:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582823.455751:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b75382a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455763:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b75382a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455772:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da58533f100) 00010000:00010000:1.0:1787582823.455775:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582823.455778:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b75382a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455783:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b75382a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455800:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455806:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455813:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455817:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582823.455821:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455826:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455833:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc900) 00010000:00010000:1.0:1787582823.455835:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582823.455845:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.455851:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582823.456042:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+27:10493:x1874416162092416:12345-192.168.206.20@tcp:34:lfs.0 Request processed in 1909us (2421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582823.456053:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 91 00000100:00100000:3.0:1787582823.510366:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582823.510412:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162092672 00000100:00100000:3.0:1787582823.510425:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162092672 00000100:00100000:3.0:1787582823.510487:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 92 00000100:00100000:3.0:1787582823.510499:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+27:10496:x1874416162092672:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:3.0:1787582823.510525:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582823.510740:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b75382b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d580d5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.510834:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75382b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.510918:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75382b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.510934:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75382b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.510953:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75382bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.510962:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75382bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.511712:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75382bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.512469:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b75382c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.512485:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b75382c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.512495:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b75382c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582823.512508:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787582823.512623:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75382b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.513592:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75382b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.513608:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75382b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.513614:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582823.513620:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75382b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.513629:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75382b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.514183:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:3.0:1787582823.514186:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582823.514193:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75382b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.514222:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75382b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.514242:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75382bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.514249:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75382bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.514255:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75382bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.514260:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582823.514264:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75382bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.514270:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75382bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.514278:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da583acc100) 00010000:00010000:3.0:1787582823.514280:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582823.514283:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75382bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.514299:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75382bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.514417:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b75382b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580d5 expref: 30 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.514434:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b75382c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580d5 expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.514448:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc900) 00010000:00010000:3.0:1787582823.514451:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787582823.514454:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1800, rc 0) 00000100:00100000:3.0:1787582823.514540:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+29:10496:x1874416162092672:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 4040us (4187us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1787582823.514550:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 92 00000100:00100000:3.0:1787582823.520041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582823.520282:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162092800 00000100:00100000:2.0:1787582823.520303:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162092800 00000100:00100000:1.0:1787582823.520408:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 93 00000100:00100000:1.0:1787582823.520422:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+29:10496:x1874416162092800:12345-192.168.206.20@tcp:54:lfs.0 00010000:00010000:1.0:1787582823.520505:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.520525:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580c0 expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.520589:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382d4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.520683:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580c0 expref: 29 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.520700:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580c0 expref: 29 pid: 5854 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582823.520717:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1874416186230784:192.168.206.20@tcp:104: 00000100:00100000:1.0:1787582823.520888:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a05ef180 going to sleep for 11 seconds 00000100:00100000:3.0:1787582823.525999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582823.526045:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162093056 00000100:00100000:3.0:1787582823.526056:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162093056 00000100:00100000:3.0:1787582823.526118:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 22 00000100:00100000:3.0:1787582823.526130:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+30:5597:x1874416162093056:12345-192.168.206.20@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787582823.526580:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+31:5597:x1874416162093056:12345-192.168.206.20@tcp:35:ldlm_bl.0 Request processed in 449us (592us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787582823.526589:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 22 00000100:00100000:0.0:1787582823.527535:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1874416186230784:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582823.527571:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582823.532660:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582823.532925:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162093184 00000100:00100000:3.0:1787582823.532938:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162093184 00010000:00010000:3.0:1787582823.532986:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580c0 expref: 31 pid: 5854 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582823.533031:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 48 00000100:00100000:3.0:1787582823.533043:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+31:2359:x1874416162093184:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582823.533058:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582823.533067:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580c0 expref: 31 pid: 5854 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.533104:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580c0 expref: 31 pid: 5854 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.533133:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538279 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580c0 expref: 31 pid: 5854 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.533152:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc900) 00010000:00010000:3.0:1787582823.533159:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.533169:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.533177:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382d4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.533205:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582823.533437:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+30:2359:x1874416162093184:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 395us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582823.533447:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 48 00010000:00010000:0.0:1787582823.535786:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.535806:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.535850:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.535858:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.535880:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.535887:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582823.535892:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.535900:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.535919:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc900) 00010000:00010000:0.0:1787582823.535923:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787582823.535928:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.535935:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75382d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582823.536052:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+29:10496:x1874416162092800:12345-192.168.206.20@tcp:54:lfs.0 Request processed in 15626us (16031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582823.536064:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 93 00000100:00100000:3.0:1787582823.540799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582823.540856:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162093440 00000100:00100000:2.0:1787582823.540869:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162093440 00000100:00100000:2.0:1787582823.540939:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 23 00000100:00100000:2.0:1787582823.540950:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+29:10496:x1874416162093440:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:2.0:1787582823.541256:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+30:10496:x1874416162093440:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 306us (469us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787582823.541263:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 23 00000001:00080000:0.0:1787582823.570080:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1787582823.692132:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582823.692878:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162093696 00000100:00100000:2.0:1787582823.692893:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162093696 00000100:00100000:2.0:1787582823.692973:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 94 00000100:00100000:2.0:1787582823.692986:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+30:10507:x1874416162093696:12345-192.168.206.20@tcp:101:cat.0 00010000:00010000:2.0:1787582823.693017:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582823.693153:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75382db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d580dc expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.693254:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75382e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.693405:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75382e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.693419:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75382e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.693438:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75382e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.693446:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75382e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.693453:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75382e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.694455:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b75382f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.694470:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b75382f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.694480:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b75382f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582823.694491:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787582823.695211:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75382e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695224:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75382e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695232:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75382e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695249:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9e800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582823.695255:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75382e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695362:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75382e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695382:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:2.0:1787582823.695385:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582823.695391:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75382e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695397:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75382e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695413:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75382e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695419:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75382e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695425:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75382e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695430:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9f000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582823.695433:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75382e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695439:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75382e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695457:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da5a4492200) 00010000:00010000:2.0:1787582823.695459:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582823.695462:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75382e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695468:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75382e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695529:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75382db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580dc expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695543:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b75382f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580dc expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.695550:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc900) 00010000:00010000:2.0:1787582823.695553:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787582823.695555:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9f800, rc 0) 00000100:00100000:2.0:1787582823.697800:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+32:10507:x1874416162093696:12345-192.168.206.20@tcp:101:cat.0 Request processed in 4801us (5667us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1787582823.697815:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 94 00000100:00100000:1.0:1787582823.710661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582823.710812:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162093952 00000100:00100000:3.0:1787582823.710826:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162093952 00000100:00100000:3.0:1787582823.710969:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 24 00000100:00100000:3.0:1787582823.710982:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+32:10507:x1874416162093952:12345-192.168.206.20@tcp:35:cat.0 00000100:00100000:3.0:1787582823.711368:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+33:10507:x1874416162093952:12345-192.168.206.20@tcp:35:cat.0 Request processed in 388us (732us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787582823.711386:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 24 00000100:00100000:0.0:1787582823.745843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582823.746078:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162094208 00000100:00100000:2.0:1787582823.746091:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162094208 00000100:00100000:2.0:1787582823.746164:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 95 00000100:00100000:2.0:1787582823.746174:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+33:10508:x1874416162094208:12345-192.168.206.20@tcp:36:rm.0 00010000:00010000:2.0:1787582823.746244:0:7653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787582823.746402:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b75382f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580dc expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.746458:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b75382c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580d5 expref: 32 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.746474:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b753828e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580c7 expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.746485:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da583acc900) 00010000:00010000:2.0:1787582823.746497:0:7653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787582823.746857:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75382fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.746874:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75382fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.746885:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75382fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.747005:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538305 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.747014:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.747021:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.747994:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753830c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.748007:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753830c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.748025:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753830c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787582823.751913:0:7653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1787582823.752127:0:7653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 364758616352ns, next at 365758611337ns, rc = 0 00010000:00010000:2.0:1787582823.752231:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538313 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752252:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752485:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752496:0:7653:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538313 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752504:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538313 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752511:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538313 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752808:0:7653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787582823.752841:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753830c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752848:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753830c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752856:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753830c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752877:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9e800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582823.752883:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753830c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752901:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753830c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752917:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da5a4492c00) 00010000:00010000:2.0:1787582823.752920:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787582823.752924:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753830c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752929:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753830c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752959:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75382fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752965:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75382fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752972:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75382fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752976:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9ec00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582823.752979:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75382fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.752985:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75382fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.753004:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:2.0:1787582823.753007:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582823.753011:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75382fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.753017:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75382fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787582823.753028:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035c45516 reply state 00000000887e0229 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582823.753040:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787582823.753165:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+32:10508:x1874416162094208:12345-192.168.206.20@tcp:36:rm.0 Request processed in 6985us (7329us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787582823.764498:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 95 00010000:00010000:3.0:1787582823.768384:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.768408:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538305 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.768416:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538305 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.768423:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9f000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582823.768429:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538305 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.768438:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538305 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.768461:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da5a4492200) 00010000:00010000:3.0:1787582823.768464:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582823.768470:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538305 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.768476:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538305 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.770624:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582823.770641:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538313 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.770653:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9ee00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:1.0:1787582823.770658:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538313 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.770668:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538313 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.770687:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8da5a4492c00) 00010000:00010000:1.0:1787582823.770690:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787582823.770696:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538313 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.770701:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538313 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.770727:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582823.770729:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582823.770731:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582823.816464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582823.816656:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162094464 00000100:00100000:3.0:1787582823.816668:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162094464 00000100:00100000:3.0:1787582823.816740:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 96 00000100:00100000:3.0:1787582823.816751:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+31:10514:x1874416162094464:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:3.0:1787582823.816784:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582823.816830:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753831a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d580e3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.816996:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538321 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.817012:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538321 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.817025:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538321 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.817042:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7538328 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.817050:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7538328 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.817056:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7538328 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787582823.819642:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787582823.819970:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753832f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.819989:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753832f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.820003:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753832f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.820049:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538321 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.820075:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538321 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.820083:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538321 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.820099:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582823.820105:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538321 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.820114:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538321 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.820130:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:3.0:1787582823.820134:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582823.820139:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538321 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.820146:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538321 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787582823.820163:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bec6deeb reply state 00000000928ebf45 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7538328 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582823.820173:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787582823.820216:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b753831a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580e3 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.820232:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753832f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580e3 expref: 33 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.820251:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da583acc800) 00010000:00010000:3.0:1787582823.820253:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787582823.820256:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1400, rc 0) 00000100:00100000:3.0:1787582823.820629:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+34:10514:x1874416162094464:12345-192.168.206.20@tcp:101:bash.0 Request processed in 3878us (4178us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787582823.820639:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 96 00000100:00100000:0.0:1787582823.827036:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582823.827736:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162094592 00000100:00100000:2.0:1787582823.827751:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162094592 00000100:00100000:2.0:1787582823.827849:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 35 00000100:00100000:2.0:1787582823.827862:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162094592:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:2.0:1787582823.827884:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582823.827914:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be92d68a/0xa113d808b753833d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d580ea expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787582823.827948:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787582823.827975:0:6703:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=364s v=(0 0) 00010000:00010000:2.0:1787582823.827980:0:6703:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787582823.827992:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be92d68a/0xa113d808b753833d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ea expref: 6 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.828038:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be92d68a/0xa113d808b753833d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ea expref: 6 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582823.828053:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9ec00, rc 0) 00000100:00100000:2.0:1787582823.828135:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162094592:12345-192.168.206.20@tcp:101:bash.0 Request processed in 275us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582823.828142:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 35 00000100:00080000:0.0:1787582823.828961:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787582823.829036:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7538328 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.829049:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7538328 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.829058:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7538328 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.829065:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582823.829071:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7538328 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.829092:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7538328 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.829121:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da583acc100) 00010000:00010000:1.0:1787582823.829124:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582823.829129:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7538328 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582823.829136:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7538328 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582823.831092:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582823.831508:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162094720 00000100:00100000:3.0:1787582823.831521:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162094720 00000100:00100000:3.0:1787582823.831597:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 36 00000100:00100000:3.0:1787582823.831610:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:10514:x1874416162094720:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:3.0:1787582823.831632:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582823.831665:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d580f1 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.831705:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be92d68a/0xa113d808b753833d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ea expref: 7 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.831721:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582823.831726:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582823.831731:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.831779:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be92d68a/0xa113d808b753833d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ea expref: 7 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.831816:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be92d68a/0xa113d808b753833d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ea expref: 7 pid: 6703 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582823.831833:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1874416186230912:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582823.831944:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fd0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582823.840051:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582823.841032:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1874416186230912:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582823.841079:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582823.841116:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0200, rc 0) 00000100:00100000:3.0:1787582823.841198:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:10514:x1874416162094720:12345-192.168.206.20@tcp:101:bash.0 Request processed in 9590us (10116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582823.841208:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 36 00000100:00100000:0.0:1787582823.842065:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162094848 00000100:00100000:0.0:1787582823.842076:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162094848 00010000:00010000:0.0:1787582823.842244:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be92d68a/0xa113d808b753833d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ea expref: 7 pid: 6703 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582823.842480:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 49 00000100:00100000:0.0:1787582823.842493:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5911a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2359:x1874416162094848:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787582823.842511:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582823.842551:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be92d68a/0xa113d808b753833d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ea expref: 7 pid: 6703 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.842568:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be92d68a/0xa113d808b753833d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ea expref: 7 pid: 6703 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.842595:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be92d68a/0xa113d808b753833d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ea expref: 7 pid: 6703 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.842622:0:8463:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582823.842628:0:8463:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582823.842636:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.842655:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.842699:0:8463:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582823.842745:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb6e5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8463:1874416186231040:192.168.206.20@tcp:105: 00000100:00100000:0.0:1787582823.844971:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b51f0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787582823.858384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582823.858619:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162095104 00000100:00100000:3.0:1787582823.858632:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162095104 00000100:00100000:3.0:1787582823.858712:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 25 00000100:00100000:3.0:1787582823.858731:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+33:10514:x1874416162095104:12345-192.168.206.20@tcp:35:bash.0 00000100:00100000:3.0:1787582823.859526:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+34:10514:x1874416162095104:12345-192.168.206.20@tcp:35:bash.0 Request processed in 793us (1152us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787582823.859537:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 25 00000100:00100000:0.0:1787582823.862718:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb6e5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8463:1874416186231040:192.168.206.20@tcp:105: 00010000:00010000:0.0:1787582823.862752:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582823.862826:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5911a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162094848:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 20333us (22785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582823.862838:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 49 00010000:00010000:0.0:1787582823.888613:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582823.998051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582823.998179:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162095232 00000100:00100000:0.0:1787582823.998192:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162095232 00000100:00100000:0.0:1787582823.998280:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 97 00000100:00100000:0.0:1787582823.998302:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+34:10531:x1874416162095232:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582823.998371:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582823.998398:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753834b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d580f8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.998480:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538352 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.998497:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.998513:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582823.998593:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787582823.998613:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582823.998640:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.998669:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753834b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f8 expref: 36 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.998690:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f8 expref: 35 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582823.998701:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:0.0:1787582823.998704:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787582823.998708:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ee000, rc 0) 00000100:00100000:0.0:1787582823.998777:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+35:10531:x1874416162095232:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 479us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582823.998785:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 97 00000100:00100000:2.0:1787582824.004358:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582824.004451:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162095488 00000100:00100000:0.0:1787582824.004464:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162095488 00000100:00100000:0.0:1787582824.004535:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 98 00000100:00100000:0.0:1787582824.004549:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+35:10531:x1874416162095488:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582824.004577:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582824.004602:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538359 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d580ff expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.004726:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538360 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.004742:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.004776:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538360 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582824.004789:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787582824.004947:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538359 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ff expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.004969:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538360 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ff expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.004979:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da583acc800) 00010000:00010000:0.0:1787582824.004982:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582824.004986:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ef800, rc 0) 00000100:00100000:0.0:1787582824.005070:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+37:10531:x1874416162095488:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 523us (765us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787582824.005078:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 98 00000100:00100000:1.0:1787582824.009502:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582824.009558:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582824.009595:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162095872 00000100:00100000:1.0:1787582824.009607:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162095872 00000100:00100000:1.0:1787582824.009677:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 6 00000100:00100000:1.0:1787582824.009689:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+37:2359:x1874416162095872:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582824.009708:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582824.009741:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538360 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ff expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.009765:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da583acc800) 00010000:00010000:1.0:1787582824.009771:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582824.009994:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162095744 00000100:00100000:0.0:1787582824.010000:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162095744 00000100:00100000:0.0:1787582824.010036:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 99 00000100:00100000:0.0:1787582824.010044:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+37:10531:x1874416162095744:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582824.010069:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582824.010086:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b753836e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58106 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.010210:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538375 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582824.010234:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+38:2359:x1874416162095872:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 547us (675us total) trans 0 rc 0/0 00010000:00010000:0.0:1787582824.010253:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.010265:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582824.010279:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:1.0:1787582824.010380:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 6 00010000:00010000:0.0:1787582824.010470:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b753836e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58106 expref: 39 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.010487:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538375 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58106 expref: 38 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.010495:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da583acc800) 00010000:00010000:0.0:1787582824.010498:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787582824.010500:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ee200, rc 0) 00000100:00100000:0.0:1787582824.010531:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+38:10531:x1874416162095744:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 488us (1044us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787582824.010537:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 99 00000100:00100000:1.0:1787582824.013986:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582824.014090:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162096000 00000100:00100000:2.0:1787582824.014104:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162096000 00000100:00100000:2.0:1787582824.014223:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 37 00000100:00100000:2.0:1787582824.014235:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2360:x1874416162096000:12345-192.168.206.20@tcp:1:lfs.0 00010000:00010000:2.0:1787582824.014400:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e4e0041/0xa113d808b7538383 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.014427:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.014436:0:6703:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787582824.014441:0:6703:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787582824.014446:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e4e0041/0xa113d808b7538383 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.014491:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.014608:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 6 pid: 6704 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582824.014629:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1874416186231168:192.168.206.20@tcp:104: 00000100:00100000:2.0:1787582824.014762:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787582824.017957:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582824.018100:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1874416186231168:192.168.206.20@tcp:104: 00010000:00010000:2.0:1787582824.018145:0:6703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006e4e0041/0xa113d808b7538383 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582824.018376:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162096128 00000100:00100000:0.0:1787582824.018384:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162096128 00002000:00100000:0.0:1787582824.018442:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8da481e6d180 x1874416162096128/t0(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:290/0 lens 504/0 e 0 to 0 dl 1787582835 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787582824.018452:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da481e6d180 with x1874416162096128 ext(0->8) 00010000:00010000:0.0:1787582824.018459:0:6710:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 7 pid: 6704 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.018497:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 7 pid: 6704 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787582824.018506:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8da481e6d180 00000100:00100000:0.0:1787582824.018665:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 1 00000100:00100000:0.0:1787582824.018677:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2359:x1874416162096128:12345-192.168.206.20@tcp:4:lfs.0 00000100:00100000:0.0:1787582824.020227:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:2359:x1874416162096128:12345-192.168.206.20@tcp:4:lfs.0 Request processed in 1541us (2272us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787582824.020242:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 1 00002000:00100000:0.0:1787582824.020535:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8da481e6d180 x1874416162096128/t4294967302(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:290/0 lens 504/448 e 0 to 0 dl 1787582835 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787582824.020546:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da481e6d180 with x1874416162096128 ext(0->8) 00010000:00010000:0.0:1787582824.020558:0:6710:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 9 pid: 6704 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.020578:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 9 pid: 6704 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787582824.020587:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8da481e6d180 00000100:00100000:1.0:1787582824.022965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582824.024363:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162096256 00000100:00100000:2.0:1787582824.024380:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162096256 00010000:00010000:2.0:1787582824.024504:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 9 pid: 6704 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582824.024571:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 50 00000100:00100000:2.0:1787582824.024582:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:2358:x1874416162096256:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582824.024602:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787582824.024627:0:5838:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787582824.024630:0:5838:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787582824 00002000:00010000:2.0:1787582824.024632:0:5838:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787582824 00002000:00010000:2.0:1787582824.024634:0:5838:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787582824 00010000:00010000:2.0:1787582824.024642:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 9 pid: 6704 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.024684:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 9 pid: 6704 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.024724:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065733c97/0xa113d808b7538344 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f1 expref: 9 pid: 6704 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.024745:0:5838:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787582824.024750:0:5838:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787582824.024756:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006e4e0041/0xa113d808b7538383 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.024767:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e4e0041/0xa113d808b7538383 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.024983:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582824.025064:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2358:x1874416162096256:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 483us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582824.025072:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 50 00010000:00010000:3.0:1787582824.026794:0:6703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006e4e0041/0xa113d808b7538383 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.026942:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e4e0041/0xa113d808b7538383 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.026989:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e4e0041/0xa113d808b7538383 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.026998:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e4e0041/0xa113d808b7538383 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.027007:0:6703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e4e0041/0xa113d808b7538383 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.027015:0:6703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9f800 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582824.027020:0:6703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4e0041/0xa113d808b7538383 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.027029:0:6703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4e0041/0xa113d808b7538383 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.027057:0:6703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e4e0041/0xa113d808b7538383 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.027065:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e4e0041/0xa113d808b7538383 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582824.027273:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2360:x1874416162096000:12345-192.168.206.20@tcp:1:lfs.0 Request processed in 13034us (13294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582824.027293:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 37 00000100:00100000:1.0:1787582824.030467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582824.030993:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162096512 00000100:00100000:2.0:1787582824.031007:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162096512 00000100:00100000:2.0:1787582824.031180:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 26 00000100:00100000:2.0:1787582824.031193:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583666050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+38:10531:x1874416162096512:12345-192.168.206.20@tcp:35:lfs.0 00000004:00010000:2.0:1787582824.031300:0:5857:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538375 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58106 expref: 38 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787582824.031794:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1787582824.031845:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1787582824.032253:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1787582824.032380:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b753838a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.032399:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753832f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580e3 expref: 42 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.032408:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b753838a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.032454:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753832f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580e3 expref: 42 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.032472:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753832f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580e3 expref: 42 pid: 5854 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582824.032489:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5857:1874416186231296:192.168.206.20@tcp:104: 00000100:00100000:2.0:1787582824.033055:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787582824.036728:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582824.036806:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162096640 00000100:00100000:0.0:1787582824.036818:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162096640 00010000:00010000:0.0:1787582824.036872:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753832f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580e3 expref: 43 pid: 5854 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582824.036945:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 51 00000100:00100000:0.0:1787582824.036958:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+43:2360:x1874416162096640:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787582824.036976:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582824.036984:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753832f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580e3 expref: 43 pid: 5854 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.036999:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753832f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580e3 expref: 43 pid: 5854 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.037036:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da583acc800) 00010000:00010000:0.0:1787582824.037042:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b753838a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.037052:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b753838a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.037061:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b753838a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.037085:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582824.037156:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+43:2360:x1874416162096640:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 201us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582824.037165:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 51 00010000:00010000:2.0:1787582824.038963:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b753832f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580e3 expref: 42 pid: 5854 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582824.038993:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5857:1874416186231296:192.168.206.20@tcp:104: 00010000:00010000:2.0:1787582824.039021:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b753838a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.039054:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b753838a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.039060:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b753838a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787582824.039334:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787582824.039656:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1787582824.040295:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1874416186231424:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787582824.040415:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582824.040707:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58921dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582824.040823:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186231424 00000100:00100000:0.0:1787582824.040835:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186231424 00000100:00100000:0.0:1787582824.040990:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787582824.041001:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874416186231424:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1787582824.041202:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787582824.041240:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874416186231424:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 241us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582824.041249:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787582824.041400:0:5857:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1787582824.041407:0:5857:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1787582824.041431:0:5857:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8da5adf78a80, transno 4294967301 00000100:00100000:1.0:1787582824.041525:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1874416186231424:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787582824.042819:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787582824.042987:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da589c7ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1874416186231552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787582824.043057:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582824.043096:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da586c710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582824.043126:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186231552 00000100:00100000:3.0:1787582824.043135:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186231552 00000100:00100000:3.0:1787582824.043190:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787582824.043201:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5857:x1874416186231552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787582824.043469:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5857:x1874416186231552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 269us (410us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1787582824.043478:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787582824.043678:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da589c7ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1874416186231552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787582824.043791:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787582824.043835:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b753838a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.043847:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b753838a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.043856:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b753838a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.043863:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9fe00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582824.043868:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b753838a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.043888:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b753838a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.043906:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da583acc800) 00010000:00010000:1.0:1787582824.043910:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787582824.043916:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b753838a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.043923:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b753838a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787582824.044196:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787582824.044476:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787582824.044489:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365051170744ns, next at 366051168079ns, rc = 0 00000001:00080000:1.0:1787582824.044497:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787582824.044532:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da583acc800) 00010000:00010000:1.0:1787582824.044535:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787582824.044543:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538375 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58106 expref: 46 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582824.044770:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583666050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+45:10531:x1874416162096512:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 13579us (14317us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787582824.044780:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 26 00000020:00080000:1.0:1787582824.044785:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787582824.047407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582824.047487:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162096768 00000100:00100000:0.0:1787582824.047499:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162096768 00000100:00100000:0.0:1787582824.047574:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 100 00000100:00100000:0.0:1787582824.047587:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+45:10531:x1874416162096768:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582824.047616:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582824.047649:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538391 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5810d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.047850:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538391 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5810d expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.047868:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538391 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5810d expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.047890:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:0.0:1787582824.047894:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787582824.047898:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20eee00, rc 0) 00000100:00100000:0.0:1787582824.047969:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+46:10531:x1874416162096768:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 384us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582824.047977:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 100 00000100:00100000:2.0:1787582824.050904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582824.051590:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162097024 00000100:00100000:1.0:1787582824.051605:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162097024 00000100:00100000:1.0:1787582824.051731:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 27 00000100:00100000:1.0:1787582824.051744:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+46:10531:x1874416162097024:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:1.0:1787582824.052060:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+47:10531:x1874416162097024:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 318us (1169us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1787582824.052068:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 27 00000100:00100000:3.0:1787582824.119838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582824.119980:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162097152 00000100:00100000:0.0:1787582824.119994:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162097152 00000100:00100000:0.0:1787582824.120073:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 101 00000100:00100000:0.0:1787582824.120087:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+47:10541:x1874416162097152:12345-192.168.206.20@tcp:34:lfs.0 00010000:00010000:0.0:1787582824.120215:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538398 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120238:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538398 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120252:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538398 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120278:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753839f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120296:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753839f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120303:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753839f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120479:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120489:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120496:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787582824.120547:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120563:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538398 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120581:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538398 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120588:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538398 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120594:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582824.120599:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538398 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120606:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538398 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120621:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:0.0:1787582824.120624:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582824.120630:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538398 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120636:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538398 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120652:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753839f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120659:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753839f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120665:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753839f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120670:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ef800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582824.120681:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753839f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120688:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753839f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120697:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da5a0b68800) 00010000:00010000:0.0:1787582824.120699:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582824.120702:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753839f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120708:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753839f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120724:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120730:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120736:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120741:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efe00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582824.120745:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120751:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120758:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:0.0:1787582824.120761:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582824.120771:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.120777:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582824.120887:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+47:10541:x1874416162097152:12345-192.168.206.20@tcp:34:lfs.0 Request processed in 801us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582824.120896:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 101 00000100:00100000:0.0:1787582824.153906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582824.154095:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162097408 00000100:00100000:3.0:1787582824.154107:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162097408 00000100:00100000:3.0:1787582824.154233:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 102 00000100:00100000:3.0:1787582824.154248:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+47:10544:x1874416162097408:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:3.0:1787582824.154277:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582824.154367:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75383ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58114 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154462:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75383b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154479:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75383b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154494:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75383b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154532:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154540:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154548:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154734:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75383c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154743:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75383c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154751:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75383c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582824.154763:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787582824.154886:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75383b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154894:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75383b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154901:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75383b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154908:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582824.154913:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75383b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154932:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75383b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154959:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:3.0:1787582824.154962:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582824.154967:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75383b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154974:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75383b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154989:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.154994:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.155000:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.155015:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582824.155018:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.155025:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.155032:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da583accb00) 00010000:00010000:3.0:1787582824.155035:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582824.155038:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.155057:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.155108:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75383ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58114 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.155124:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75383c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58114 expref: 49 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.155132:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:3.0:1787582824.155134:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787582824.155138:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1c00, rc 0) 00000100:00100000:3.0:1787582824.155211:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+49:10544:x1874416162097408:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 966us (1318us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787582824.155220:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 102 00000100:00100000:3.0:1787582824.157687:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582824.157891:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162097536 00000100:00100000:0.0:1787582824.157905:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162097536 00000100:00100000:0.0:1787582824.157990:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 103 00000100:00100000:0.0:1787582824.158480:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+49:10544:x1874416162097536:12345-192.168.206.20@tcp:54:lfs.0 00010000:00010000:0.0:1787582824.158569:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.158590:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.158604:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.158639:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.158646:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.158653:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.158678:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efe00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582824.158683:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.158692:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.158767:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:0.0:1787582824.158770:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787582824.158776:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.158782:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75383d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582824.158919:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+49:10544:x1874416162097536:12345-192.168.206.20@tcp:54:lfs.0 Request processed in 917us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582824.158928:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 103 00000100:00100000:1.0:1787582824.164733:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582824.164855:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162097792 00000100:00100000:2.0:1787582824.164869:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162097792 00000100:00100000:2.0:1787582824.164979:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 28 00000100:00100000:2.0:1787582824.164992:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+49:10544:x1874416162097792:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:2.0:1787582824.165393:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+50:10544:x1874416162097792:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 402us (672us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787582824.165412:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 28 00000100:00100000:1.0:1787582824.245884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582824.246207:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162098048 00000100:00100000:0.0:1787582824.246222:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162098048 00000100:00100000:3.0:1787582824.246673:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 104 00000100:00100000:3.0:1787582824.246690:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+50:10554:x1874416162098048:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:3.0:1787582824.246721:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582824.246725:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787582824.246757:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538352 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580f8 expref: 50 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.246780:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:3.0:1787582824.246785:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787582824.246800:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75383d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5811b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.246928:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.246941:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75383c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58114 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.246950:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.246984:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75383c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58114 expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.246998:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75383c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58114 expref: 50 pid: 5854 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582824.247013:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1874416186231680:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582824.247575:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fd0540 going to sleep for 11 seconds 00000100:00100000:0.0:1787582824.260947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582824.261050:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162098176 00000100:00100000:2.0:1787582824.261064:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162098176 00010000:00010000:2.0:1787582824.261121:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75383c2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58114 expref: 51 pid: 5854 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582824.261174:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 52 00000100:00100000:2.0:1787582824.261185:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+51:2359:x1874416162098176:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582824.261222:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582824.261230:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75383c2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58114 expref: 51 pid: 5854 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.261246:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75383c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58114 expref: 51 pid: 5854 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.261299:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:2.0:1787582824.261305:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.261340:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.261349:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.261373:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582824.261443:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+51:2359:x1874416162098176:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 259us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582824.261452:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 52 00010000:00010000:3.0:1787582824.261643:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75383c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58114 expref: 50 pid: 5854 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582824.261663:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1874416186231680:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582824.261688:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.261698:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.263409:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582824.263448:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787582824.263664:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75383d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5811b expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.263690:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5811b expref: 50 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.263701:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:3.0:1787582824.263705:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787582824.263709:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0c00, rc 0) 00000100:00100000:3.0:1787582824.263771:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+50:10554:x1874416162098048:12345-192.168.206.20@tcp:101:bash.0 Request processed in 17085us (17901us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787582824.263781:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 104 00000100:00100000:1.0:1787582824.267862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582824.267973:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162098432 00000100:00100000:2.0:1787582824.267987:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162098432 00000100:00100000:2.0:1787582824.268061:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 105 00000100:00100000:2.0:1787582824.268073:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+50:10554:x1874416162098432:12345-192.168.206.20@tcp:36:bash.0 00010000:00010000:2.0:1787582824.270927:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b75383ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.270958:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b75383ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.270991:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b75383ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787582824.271100:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787582824.271130:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a93a7a91 reply state 00000000e34acb25 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b75383ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582824.271141:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787582824.271295:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+53:10554:x1874416162098432:12345-192.168.206.20@tcp:36:bash.0 Request processed in 3209us (3431us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787582824.271305:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 105 00000020:00080000:2.0:1787582824.271312:0:7653:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787582824.277062:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00010000:00010000:3.0:1787582824.277136:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b75383ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.277150:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b75383ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.277160:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b75383ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.277167:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9f400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582824.277172:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b75383ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.277201:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b75383ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.277223:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:3.0:1787582824.277226:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582824.277231:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b75383ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.277237:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b75383ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582824.277338:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162098560 00000100:00100000:2.0:1787582824.277357:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162098560 00000100:00100000:2.0:1787582824.277418:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 106 00000100:00100000:2.0:1787582824.277429:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+52:10554:x1874416162098560:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:2.0:1787582824.277458:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582824.277477:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b75383f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58122 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.277571:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.277586:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5811b expref: 53 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.277595:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.277643:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5811b expref: 53 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.277659:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5811b expref: 53 pid: 5854 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582824.277674:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186231808:192.168.206.20@tcp:104: 00000100:00100000:2.0:1787582824.277757:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58921dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582824.283708:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582824.284128:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186231808:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582824.284163:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582824.284248:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162098688 00000100:00100000:1.0:1787582824.284267:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162098688 00010000:00010000:1.0:1787582824.284368:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5811b expref: 54 pid: 5854 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582824.284408:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 53 00000100:00100000:1.0:1787582824.284419:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+54:2360:x1874416162098688:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582824.284438:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582824.284446:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5811b expref: 54 pid: 5854 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.284461:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5811b expref: 54 pid: 5854 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.284488:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75383de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5811b expref: 54 pid: 5854 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.284507:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:1.0:1787582824.284513:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.284544:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.284553:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.284574:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582824.284636:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+53:2360:x1874416162098688:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 219us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582824.284645:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 53 00010000:00010000:0.0:1787582824.285119:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.285144:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582824.285205:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787582824.285210:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582824.285238:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.285302:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b75383f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58122 expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.285570:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58122 expref: 52 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.285581:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:0.0:1787582824.285584:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582824.285588:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9ea00, rc 0) 00000100:00100000:0.0:1787582824.285646:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+52:10554:x1874416162098560:12345-192.168.206.20@tcp:101:bash.0 Request processed in 8219us (8595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582824.285656:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 106 00000100:00100000:3.0:1787582824.301226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582824.310254:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162098944 00000100:00100000:1.0:1787582824.310277:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162098944 00000100:00100000:2.0:1787582824.310515:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 29 00000100:00100000:2.0:1787582824.310529:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+52:10554:x1874416162098944:12345-192.168.206.20@tcp:35:bash.0 00000100:00100000:2.0:1787582824.310863:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+53:10554:x1874416162098944:12345-192.168.206.20@tcp:35:bash.0 Request processed in 335us (9651us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787582824.310872:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 29 00000100:00100000:1.0:1787582824.401587:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582824.401929:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162099072 00000100:00100000:2.0:1787582824.401943:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162099072 00000100:00100000:2.0:1787582824.402020:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 107 00000100:00100000:2.0:1787582824.402033:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+53:10560:x1874416162099072:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582824.402064:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582824.402093:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58129 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.402182:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538408 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.402199:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.402229:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582824.402680:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582824.402729:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582824.402763:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582824.402789:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162099456 00000100:00100000:1.0:1787582824.402793:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162099200 00000100:00100000:3.0:1787582824.402795:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162099456 00000100:00100000:1.0:1787582824.402797:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162099200 00000100:00080000:3.0:1787582824.402821:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582824.402831:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 288 00000100:00100000:1.0:1787582824.402838:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2359:x1874416162099200:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582824.402847:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 136 00000100:00100000:3.0:1787582824.402854:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83345526-3920-4b94-b598-4d9f74280322+5:2359:x1874416162099456:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582824.402911:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162099328 00000100:00100000:3.0:1787582824.402913:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83345526-3920-4b94-b598-4d9f74280322+5:2359:x1874416162099456:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 59us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582824.402915:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162099328 00000100:00100000:3.0:1787582824.402921:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 136 00000100:00100000:0.0:1787582824.402950:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 74 00000100:00100000:0.0:1787582824.402958:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2359:x1874416162099328:12345-192.168.206.20@tcp:400:kworker.0 00000004:00200000:2.0:1787582824.402998:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787582824.403003:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787582824.403041:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.403081:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58129 expref: 55 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.403102:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538408 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58129 expref: 54 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.403113:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:2.0:1787582824.403116:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787582824.403120:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9f400, rc 0) 00000100:00100000:1.0:1787582824.412065:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2359:x1874416162099200:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 9207us (9315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582824.412084:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 288 00000100:00100000:0.0:1787582824.412578:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2359:x1874416162099328:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 9616us (9895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582824.412589:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 74 00000100:00100000:2.0:1787582824.414597:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+54:10560:x1874416162099072:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 12554us (13012us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582824.414611:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 107 00000100:00100000:3.0:1787582824.420495:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582824.420644:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162099584 00000100:00100000:0.0:1787582824.420658:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162099584 00000100:00100000:0.0:1787582824.420736:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 108 00000100:00100000:0.0:1787582824.420749:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+54:10560:x1874416162099584:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582824.420777:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582824.420802:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753840f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58130 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.420882:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538416 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.420900:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538416 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.420912:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538416 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.420930:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753841d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.420936:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753841d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.420942:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753841d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421072:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538424 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421081:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421112:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582824.421156:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787582824.421161:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582824.421181:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421194:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421202:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538416 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421208:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538416 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421214:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538416 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421220:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582824.421225:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538416 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421233:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538416 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421246:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:0.0:1787582824.421249:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582824.421254:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538416 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421272:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538416 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421300:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753841d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421308:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753841d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421314:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753841d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421361:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582824.421365:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753841d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421372:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753841d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421379:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da5a0b68800) 00010000:00010000:0.0:1787582824.421382:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582824.421385:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753841d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421391:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753841d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421426:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753840f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58130 expref: 56 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421442:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538424 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58130 expref: 55 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.421457:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:0.0:1787582824.421459:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582824.421461:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ef800, rc 0) 00000100:00100000:0.0:1787582824.421547:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:10560:x1874416162099584:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 800us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582824.421554:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 108 00000100:00100000:1.0:1787582824.433983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582824.434241:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162099840 00000100:00100000:3.0:1787582824.434266:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162099840 00000100:00100000:3.0:1787582824.434384:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 109 00000100:00100000:3.0:1787582824.434413:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf87a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:10560:x1874416162099840:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:3.0:1787582824.434441:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582824.434469:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b753842b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58137 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.434597:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.434615:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58122 expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.434624:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538424 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58130 expref: 56 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.434633:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.434676:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538424 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58130 expref: 56 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.434691:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538424 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58130 expref: 56 pid: 5855 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582824.434708:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186231936:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582824.434846:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58122 expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.434856:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58122 expref: 56 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582824.434873:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186232064:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582824.434899:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fd0540 going to sleep for 11 seconds 00000100:00100000:1.0:1787582824.438687:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582824.438796:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162099968 00000100:00100000:2.0:1787582824.438819:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162099968 00010000:00010000:2.0:1787582824.438870:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538424 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58130 expref: 57 pid: 5855 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582824.438920:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 54 00000100:00100000:2.0:1787582824.438931:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:2359:x1874416162099968:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582824.438982:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582824.438991:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538424 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58130 expref: 57 pid: 5855 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.439008:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538424 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58130 expref: 57 pid: 5855 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.439035:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:2.0:1787582824.439042:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.439051:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.439058:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582824.439127:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf879f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:2359:x1874416162099968:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 197us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582824.439135:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 54 00010000:00010000:3.0:1787582824.439786:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b7538424 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58130 expref: 56 pid: 5855 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582824.439822:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186231936:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582824.449562:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186232064:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582824.449606:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582824.451468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582824.451752:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162100096 00000100:00100000:0.0:1787582824.451764:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162100096 00010000:00010000:0.0:1787582824.451830:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58122 expref: 56 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582824.451870:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 55 00000100:00100000:0.0:1787582824.451881:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5911abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:2360:x1874416162100096:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787582824.451897:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582824.451905:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58122 expref: 56 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.451920:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58122 expref: 56 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.451945:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b75383fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58122 expref: 56 pid: 5852 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.451973:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:0.0:1787582824.451978:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.452000:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.452008:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.452051:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582824.452120:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5911abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:2360:x1874416162100096:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 241us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582824.452128:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 55 00010000:00010000:1.0:1787582824.452400:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.452410:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582824.452442:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787582824.452653:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b753842b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58137 expref: 56 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.452671:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58137 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582824.452679:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:1.0:1787582824.452681:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787582824.452684:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1c00, rc 0) 00000100:00100000:1.0:1787582824.452717:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf87a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:10560:x1874416162099840:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 18308us (18750us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787582824.452725:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 109 00000100:00100000:0.0:1787582824.456576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582824.456675:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162100352 00000100:00100000:2.0:1787582824.456688:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162100352 00000100:00100000:2.0:1787582824.456767:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 7 00000100:00100000:2.0:1787582824.456779:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:10560:x1874416162100352:12345-192.168.206.20@tcp:103:lfs.0 00010000:00010000:2.0:1787582824.456798:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582824.456840:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538391 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5810d expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582824.456864:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:2.0:1787582824.456884:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582824.456948:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+54:10560:x1874416162100352:12345-192.168.206.20@tcp:103:lfs.0 Request processed in 171us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582824.456965:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 7 00000100:00100000:2.0:1787582824.472522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582824.472626:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162100480 00000100:00100000:0.0:1787582824.472639:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162100480 00000100:00100000:0.0:1787582824.472715:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 110 00000100:00100000:0.0:1787582824.472729:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+54:10560:x1874416162100480:12345-192.168.206.20@tcp:58:lfs.0 00010000:00010000:0.0:1787582824.472897:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538440 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.472917:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538440 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582824.472931:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538440 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787582824.473182:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787582824.473362:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+54:10560:x1874416162100480:12345-192.168.206.20@tcp:58:lfs.0 Request processed in 635us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582824.473372:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 110 00000100:00100000:1.0:1787582824.477445:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582824.480428:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162100608 00000100:00100000:2.0:1787582824.480450:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162100608 00000100:00100000:3.0:1787582824.480706:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 111 00000100:00100000:3.0:1787582824.480720:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+54:10560:x1874416162100608:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:3.0:1787582824.480748:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582824.480776:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538447 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5813e expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.480861:0:7653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538440 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.480873:0:7653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538447 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5813e expref: 55 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.480898:0:7653:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538440 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.480936:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538447 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5813e expref: 55 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.481650:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:3.0:1787582824.481657:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787582824.481664:0:7653:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538447 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5813e expref: 55 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582824.481675:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0000, rc 0) 00000100:00100000:3.0:1787582824.481769:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:10560:x1874416162100608:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 1051us (4338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582824.481779:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 111 00000100:00100000:1.0:1787582824.529482:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787582824.529511:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186232192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582824.529595:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582824.529730:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186232192 00000100:00100000:2.0:1787582824.529740:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186232192 00000100:00100000:2.0:1787582824.529823:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787582824.529834:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874416186232192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582824.529879:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787582824.529897:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787582824.529943:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874416186232192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582824.529951:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787582824.530047:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186232192:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787582824.912695:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787582825.168796:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787582825.168827:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787582825.168892:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787582825.168900:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787582825.169054:0:11695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da586c7d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11695:1874416186232320:192.168.206.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787582825.169249:0:11695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b51f0900 going to sleep for 11 seconds 00000100:00100000:1.0:1787582825.185992:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582825.186174:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162100736 00000100:00100000:2.0:1787582825.186186:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162100736 00000100:00100000:2.0:1787582825.186293:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 112 00000100:00100000:2.0:1787582825.186305:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:10561:x1874416162100736:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787582825.186400:0:5855:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00080000:3.0:1787582825.186462:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787582825.186535:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf87a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:10561:x1874416162100736:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 Request processed in 230us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582825.186544:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 112 00000100:00100000:0.0:1787582825.190172:0:11695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da586c7d880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11695:1874416186232320:192.168.206.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787582825.200215:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582825.200406:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162100864 00000100:00100000:1.0:1787582825.200418:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162100864 00000100:00100000:1.0:1787582825.200489:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 113 00000100:00100000:1.0:1787582825.200501:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:10561:x1874416162100864:12345-192.168.206.20@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787582825.200594:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b753844e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.200627:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b753844e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.200662:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b753844e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.200681:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538455 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.200687:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538455 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.200693:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538455 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.200720:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b753845c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.200729:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b753845c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.200736:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b753845c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582825.200934:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787582825.200939:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582825.200955:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b753845c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.200967:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b753844e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.200974:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b753844e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.200991:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b753844e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.200998:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582825.201002:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b753844e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201011:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b753844e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201025:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8da5a0b68e00) 00010000:00010000:1.0:1787582825.201028:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582825.201033:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b753844e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201039:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b753844e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201055:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538455 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201061:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538455 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201127:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538455 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201135:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582825.201138:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538455 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201154:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538455 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201164:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8da58533f100) 00010000:00010000:1.0:1787582825.201166:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582825.201169:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538455 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201175:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538455 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201191:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b753845c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201197:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b753845c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201203:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b753845c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201208:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582825.201211:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b753845c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201217:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b753845c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201223:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:1.0:1787582825.201225:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582825.201228:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b753845c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.201246:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b753845c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582825.201774:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:10561:x1874416162100864:12345-192.168.206.20@tcp:34:lhsmtool_posix.0 Request processed in 1270us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582825.201786:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 113 00000100:00100000:3.0:1787582825.206419:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582825.206542:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162101120 00000100:00100000:2.0:1787582825.206556:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162101120 00000100:00100000:2.0:1787582825.207225:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 114 00000100:00100000:2.0:1787582825.207242:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:10561:x1874416162101120:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787582825.207366:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582825.207392:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538463 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58145 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.207513:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753846a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.207531:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753846a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.207544:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753846a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582825.207555:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787582825.207674:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753846a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.207682:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753846a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.207689:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753846a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.207769:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9e800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582825.207775:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753846a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.207783:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753846a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.207815:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:2.0:1787582825.207818:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787582825.207825:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753846a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.207831:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753846a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.208064:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538463 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58145 expref: 57 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.208076:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8da5a0b68e00) 00010000:00010000:2.0:1787582825.208079:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787582825.208083:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538463 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58145 expref: 57 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.208094:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9ec00, rc 0) 00000100:00100000:2.0:1787582825.208351:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:10561:x1874416162101120:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 1114us (2037us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787582825.208361:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 114 00000100:00100000:3.0:1787582825.211688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582825.212302:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162101248 00000100:00100000:0.0:1787582825.212355:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162101248 00000100:00100000:0.0:1787582825.212427:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 115 00000100:00100000:0.0:1787582825.212439:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:10561:x1874416162101248:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787582825.212545:0:7653:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787582825.212679:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:10561:x1874416162101248:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 Request processed in 242us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582825.212687:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 115 00000100:00100000:0.0:1787582825.218835:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582825.219198:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162101504 00000100:00100000:1.0:1787582825.219211:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162101504 00000100:00100000:1.0:1787582825.219379:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 116 00000100:00100000:1.0:1787582825.219392:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:10561:x1874416162101504:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787582825.219418:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582825.219422:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787582825.219455:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538408 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58129 expref: 56 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.219478:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:1.0:1787582825.219484:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787582825.219500:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7538478 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5814c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787582825.220144:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1787582825.226189:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b753847f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.226214:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b753847f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.226228:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b753847f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.226389:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7538478 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5814c expref: 58 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.232956:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b753847f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5814c expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.232982:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8da58533f100) 00010000:00010000:1.0:1787582825.232985:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582825.232989:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7a00, rc 0) 00000100:00100000:1.0:1787582825.233075:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:10561:x1874416162101504:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 13683us (14251us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787582825.233085:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 116 00000100:00100000:3.0:1787582825.244620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582825.244971:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162101760 00000100:00100000:0.0:1787582825.244987:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162101760 00000100:00100000:0.0:1787582825.245059:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 117 00000100:00100000:0.0:1787582825.245069:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:10561:x1874416162101760:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787582825.245121:0:7653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582825.245146:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b753847f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5814c expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245166:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8da58533f100) 00010000:00010000:0.0:1787582825.245176:0:7653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787582825.245196:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753848d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245224:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753848d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245234:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753848d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245248:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538494 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x598d3a82 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245254:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538494 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x598d3a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245260:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538494 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x598d3a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245396:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753848d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245402:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753848d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245409:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753848d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245415:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efa00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582825.245419:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753848d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245425:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753848d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245434:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:0.0:1787582825.245443:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582825.245447:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753848d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245453:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753848d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245465:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538494 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x598d3a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245471:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538494 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x598d3a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245477:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538494 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x598d3a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245482:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582825.245485:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538494 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x598d3a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245491:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538494 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x598d3a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245498:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x598d3a82 (ffff8da5a0b68800) 00010000:00010000:0.0:1787582825.245501:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582825.245503:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538494 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x598d3a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.245509:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538494 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x598d3a82 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582825.245594:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:10561:x1874416162101760:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 Request processed in 526us (988us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787582825.245608:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 117 00000100:00100000:3.0:1787582825.247932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582825.248077:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162101888 00000100:00100000:2.0:1787582825.248091:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162101888 00000100:00100000:2.0:1787582825.248159:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 118 00000100:00100000:2.0:1787582825.248170:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:10561:x1874416162101888:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787582825.248198:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582825.248228:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b753849b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58153 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.248354:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75384a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.248372:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75384a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.248387:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75384a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.248520:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b753849b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58153 expref: 58 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.248549:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75384a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58153 expref: 57 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.248559:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:2.0:1787582825.248562:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787582825.248566:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9e800, rc 0) 00000100:00100000:2.0:1787582825.248635:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:10561:x1874416162101888:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 467us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582825.248643:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 118 00000100:00100000:3.0:1787582825.252219:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582825.253433:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162102144 00000100:00100000:0.0:1787582825.253450:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162102144 00000100:00100000:0.0:1787582825.253510:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 119 00000100:00100000:0.0:1787582825.253520:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:10561:x1874416162102144:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787582825.253599:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75384a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.253615:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75384a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.253627:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75384a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787582825.253860:0:7653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1787582825.253869:0:7653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366260551139ns, next at 367260548959ns, rc = 0 00000004:00010000:0.0:1787582825.253953:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051b18d16 reply state 000000003e0670e9 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75384a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582825.253963:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787582825.254064:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+59:10561:x1874416162102144:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 Request processed in 544us (1859us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787582825.254071:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 119 00010000:00010000:1.0:1787582825.257747:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75384a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.257765:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75384a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.257774:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75384a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.257780:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582825.257785:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75384a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.257793:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75384a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.257811:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:1.0:1787582825.257831:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787582825.257836:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75384a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.257842:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75384a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582825.260696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582825.260870:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162102272 00000100:00100000:1.0:1787582825.260889:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162102272 00000100:00100000:1.0:1787582825.260956:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 120 00000100:00100000:1.0:1787582825.260967:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+58:10561:x1874416162102272:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787582825.260993:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582825.261014:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b75384b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5815a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.261076:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b75384b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5815a expref: 59 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.261091:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b75384b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5815a expref: 59 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.261111:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:1.0:1787582825.261114:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787582825.261119:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7000, rc 0) 00000100:00100000:1.0:1787582825.261187:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+59:10561:x1874416162102272:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 221us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582825.261194:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 120 00000100:00100000:3.0:1787582825.268840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582825.268955:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162102400 00000100:00100000:0.0:1787582825.268971:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162102400 00000100:00100000:0.0:1787582825.269066:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 38 00000100:00100000:0.0:1787582825.269078:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2360:x1874416162102400:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787582825.269430:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:2360:x1874416162102400:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 Request processed in 354us (605us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787582825.269453:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 38 00000100:00080000:3.0:1787582825.269475:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582825.273131:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582825.276633:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162102656 00000100:00100000:2.0:1787582825.276649:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162102656 00000100:00100000:2.0:1787582825.276719:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 30 00000100:00100000:2.0:1787582825.276728:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+59:10561:x1874416162102656:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787582825.276962:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:10561:x1874416162102656:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 Request processed in 233us (3848us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787582825.276986:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 30 00000100:00100000:1.0:1787582825.281678:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582825.281781:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162102912 00000100:00100000:0.0:1787582825.281790:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162102912 00000100:00100000:0.0:1787582825.281845:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 121 00000100:00100000:0.0:1787582825.281855:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:10561:x1874416162102912:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787582825.281955:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:10561:x1874416162102912:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 101us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582825.281962:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 121 00000100:00100000:3.0:1787582825.288412:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582825.288509:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162103040 00000100:00100000:1.0:1787582825.288538:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162103040 00000100:00100000:1.0:1787582825.288611:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 122 00000100:00100000:1.0:1787582825.288621:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:10561:x1874416162103040:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787582825.288641:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582825.288661:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b75384b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58161 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.288729:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75384be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.288743:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75384be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.288753:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75384be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582825.288789:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582825.288808:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75384be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.288833:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b75384b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58161 expref: 62 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.288852:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75384be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58161 expref: 61 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.288861:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:1.0:1787582825.288864:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787582825.288867:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7600, rc 0) 00000100:00100000:1.0:1787582825.288934:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+61:10561:x1874416162103040:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 314us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582825.288947:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 122 00000100:00100000:3.0:1787582825.308108:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582825.308918:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162103168 00000100:00100000:0.0:1787582825.308932:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162103168 00000100:00100000:0.0:1787582825.309006:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 39 00000100:00100000:0.0:1787582825.309017:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:2360:x1874416162103168:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787582825.309035:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582825.309054:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58168 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787582825.309081:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c5969, blocks: 0x1 00010000:00010000:0.0:1787582825.309099:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1787582825.309104:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582825.309114:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58168 expref: 10 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.309133:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58168 expref: 10 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.309166:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ee200, rc 0) 00000100:00100000:0.0:1787582825.309234:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:2360:x1874416162103168:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 219us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582825.309242:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 39 00000100:00100000:2.0:1787582825.312764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582825.312900:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162103424 00000100:00100000:0.0:1787582825.312910:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162103424 00000100:00100000:0.0:1787582825.312969:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 123 00000100:00100000:0.0:1787582825.312979:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+61:10561:x1874416162103424:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787582825.313089:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+61:10561:x1874416162103424:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 111us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582825.313096:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 123 00000100:00100000:3.0:1787582825.324724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582825.324838:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162103552 00000100:00100000:0.0:1787582825.324853:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162103552 00000100:00100000:0.0:1787582825.324922:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 40 00000100:00100000:0.0:1787582825.324932:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:10561:x1874416162103552:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787582825.324949:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582825.324966:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000784d5c68/0xa113d808b75384cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5816f expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.324996:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58168 expref: 11 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.325006:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582825.325010:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582825.325029:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000784d5c68/0xa113d808b75384cc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5816f expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.325064:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58168 expref: 11 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.325079:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58168 expref: 11 pid: 6704 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582825.325093:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da586c7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1874416186232448:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582825.325387:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b51f03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582825.335404:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da586c7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1874416186232448:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582825.335440:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000784d5c68/0xa113d808b75384cc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5816f expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.335460:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20efa00, rc 0) 00000100:00100000:0.0:1787582825.335535:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+11:10561:x1874416162103552:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 10604us (10840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582825.335544:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 40 00000100:00100000:1.0:1787582825.339304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582825.339473:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162103680 00000100:00100000:0.0:1787582825.339482:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162103680 00010000:00010000:0.0:1787582825.339521:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58168 expref: 11 pid: 6704 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582825.339563:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 56 00000100:00100000:0.0:1787582825.339573:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb683100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+11:2359:x1874416162103680:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787582825.339600:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582825.339623:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58168 expref: 11 pid: 6704 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.339638:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58168 expref: 11 pid: 6704 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.339660:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58168 expref: 11 pid: 6704 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.339678:0:5840:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582825.339683:0:5840:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582825.339691:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000784d5c68/0xa113d808b75384cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5816f expref: 10 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.339702:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000784d5c68/0xa113d808b75384cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5816f expref: 10 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.339741:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000784d5c68/0xa113d808b75384cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5816f expref: 10 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582825.339755:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da586c7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5840:1874416186232576:192.168.206.20@tcp:105: 00000100:00100000:0.0:1787582825.339832:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b51f03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582825.343451:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da586c7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5840:1874416186232576:192.168.206.20@tcp:105: 00010000:00010000:0.0:1787582825.343475:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582825.343529:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb683100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:2359:x1874416162103680:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 3956us (4233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582825.343539:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 56 00000100:00100000:1.0:1787582825.363102:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582825.363187:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162103808 00000100:00100000:0.0:1787582825.363197:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162103808 00002000:00100000:0.0:1787582825.363242:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8da5bb683800 x1874416162103808/t0(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:291/0 lens 504/0 e 0 to 0 dl 1787582836 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787582825.363253:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5bb683800 with x1874416162103808 ext(0->12) 00002000:00010000:0.0:1787582825.363259:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da5bb683800 00000100:00100000:0.0:1787582825.363300:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 2 00000100:00100000:0.0:1787582825.363310:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:2360:x1874416162103808:12345-192.168.206.20@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787582825.363771:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+12:2360:x1874416162103808:12345-192.168.206.20@tcp:4:lhsmtool_posix.0 Request processed in 461us (676us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787582825.363781:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 2 00002000:00100000:0.0:1787582825.363788:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8da5bb683800 x1874416162103808/t4294967308(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:291/0 lens 504/448 e 0 to 0 dl 1787582836 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787582825.363797:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5bb683800 with x1874416162103808 ext(0->12) 00002000:00010000:0.0:1787582825.363801:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da5bb683800 00000100:00100000:1.0:1787582825.367771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582825.367935:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162103936 00000100:00100000:3.0:1787582825.367948:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162103936 00000100:00100000:3.0:1787582825.368018:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 124 00000100:00100000:3.0:1787582825.368041:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+61:10561:x1874416162103936:12345-192.168.206.20@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787582825.414806:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+61:10561:x1874416162103936:12345-192.168.206.20@tcp:44:lhsmtool_posix.0 Request processed in 46755us (47036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582825.414821:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 124 00000001:00080000:0.0:1787582825.414927:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1787582825.414936:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1787582825.415230:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787582825.415264:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8da5a081c180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787582825.415270:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da5892b1c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8da5a05ef180 00000020:00080000:0.0:1787582825.415273:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da5892b1300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8da5a8e0c400 00000001:00080000:0.0:1787582825.415303:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1787582825.415374:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787582825.415412:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8da5a081c000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787582825.415416:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da589e8b300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8da5a081ca80 00000020:00080000:0.0:1787582825.415419:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da589e8b200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8da5b53d3000 00000020:00080000:0.0:1787582825.415439:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1787582825.415697:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787582825.416510:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186232960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787582825.416578:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582825.416648:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582825.416653:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186232832:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787582825.416673:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582825.416703:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186232960 00000100:00100000:1.0:1787582825.416711:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186232960 00000100:00100000:1.0:1787582825.416751:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186232832 00000100:00100000:1.0:1787582825.416753:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186232832 00000100:00100000:1.0:1787582825.416771:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787582825.416781:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1874416186232960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1787582825.416941:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787582825.416945:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787582825 00002000:00010000:1.0:1787582825.416948:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787582825.416950:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787582825 -> 1787582825 00002000:00010000:1.0:1787582825.416952:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787582825.417229:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186232704:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787582825.417264:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582825.417866:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186232704 00000100:00100000:0.0:1787582825.417874:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186232704 00000100:00100000:0.0:1787582825.417907:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787582825.417916:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3312:x1874416186232832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787582825.417938:0:6703:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1787582825.417962:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.418051:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000032ba3946/0xa113d808b7538295 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ce expref: 11 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.418061:0:6703:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787582825.418066:0:6703:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787582825.418070:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384d3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582825.418222:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3312:x1874416186232960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1441us (1642us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787582825.418230:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787582825.418268:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787582825.418286:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1874416186232704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787582825.418306:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1787582825.418353:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8c5968, atime: 0x6a8c5968, ctime: 0x6a8c5968, blocks: 0x1 00010000:00010000:1.0:1787582825.418360:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b75384da lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.418371:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=366s v=(0 0) 00010000:00010000:1.0:1787582825.418375:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582825.418381:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b75384da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.418399:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b75384da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.418411:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b75384da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.418420:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b75384da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582825.418437:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00010000:00010000:1.0:1787582825.418447:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582825.419148:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000032ba3946/0xa113d808b7538295 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ce expref: 11 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.419165:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000032ba3946/0xa113d808b7538295 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ce expref: 11 pid: 8218 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582825.419195:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da586c7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1874416186233088:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582825.419295:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b51f03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582825.419336:0:8218:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1787582825.419344:0:8218:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000004:00080000:2.0:1787582825.419709:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8da58b3ec000/2, rc 0, transno 4294967309 00000100:00100000:2.0:1787582825.419718:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186232960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787582825.419785:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162104064 00000100:00100000:0.0:1787582825.419792:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162104064 00000100:00100000:3.0:1787582825.419904:0:12082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 44 00000100:00100000:3.0:1787582825.419917:0:12082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+12:2358:x1874416162104064:12345-192.168.206.20@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1787582825.420818:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582825.420830:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b75384da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.420843:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6c00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582825.420848:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b75384da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.420860:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b75384da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.420884:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b75384da lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.420892:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b75384da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.420917:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582825.420919:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582825.420921:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582825.421539:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1874416186232704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3250us (4260us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787582825.421550:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787582825.422594:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582825.422646:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da586c7f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1874416186233088:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582825.422677:0:6703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787582825.423944:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8da5adbf7480/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787582825.423959:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186232704:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787582825.424006:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162104192 00000100:00100000:2.0:1787582825.424015:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162104192 00010000:00010000:2.0:1787582825.424264:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000032ba3946/0xa113d808b7538295 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ce expref: 13 pid: 8218 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582825.424337:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 57 00000100:00100000:2.0:1787582825.424348:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf924000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:2360:x1874416162104192:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582825.424365:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582825.424371:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000032ba3946/0xa113d808b7538295 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ce expref: 13 pid: 8218 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.424386:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000032ba3946/0xa113d808b7538295 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ce expref: 13 pid: 8218 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.424413:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032ba3946/0xa113d808b7538295 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580ce expref: 13 pid: 8218 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.424430:0:8463:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787582825.424435:0:8463:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787582825.424442:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.424453:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384d3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.424484:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582825.424561:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf924000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+12:2360:x1874416162104192:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 212us (2031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582825.424571:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 57 00010000:00010000:3.0:1787582825.424584:0:6703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.424597:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.424609:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.424618:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.425716:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787582825.426432:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3312:x1874416186232832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8510us (9751us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787582825.426454:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1787582825.426817:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8da58b3ed880/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787582825.426826:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186232832:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787582825.427788:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582825.427801:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.427816:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee200 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582825.427821:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.427833:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.427857:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.427866:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8cd7547/0xa113d808b75384d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.427908:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582825.427910:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582825.427912:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787582825.467767:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1787582825.467898:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1787582825.468095:0:12082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162104064:12345-192.168.206.20@tcp:16:lhsmtool_posix.0 Request processed in 48172us (49662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582825.468108:0:12082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 44 00000100:00100000:3.0:1787582825.470561:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582825.470628:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162104448 00000100:00100000:0.0:1787582825.470642:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162104448 00000100:00100000:0.0:1787582825.470755:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 125 00000100:00100000:0.0:1787582825.470767:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:10561:x1874416162104448:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787582825.470834:0:7653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582825.470869:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75384be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58161 expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.470895:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:0.0:1787582825.470901:0:7653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787582825.470941:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75384e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.470957:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75384e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.470979:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75384e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787582825.471547:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfba6e0d reply state 00000000a9254b58 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75384e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582825.471583:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787582825.471703:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+16:10561:x1874416162104448:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 Request processed in 936us (1154us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787582825.471713:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 125 00010000:00010000:3.0:1787582825.473773:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75384e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.473795:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75384e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.473804:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75384e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.473810:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582825.473816:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75384e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.473824:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75384e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.473845:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:3.0:1787582825.473848:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582825.473854:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75384e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.473860:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75384e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582825.474245:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582825.474304:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162104576 00000100:00100000:0.0:1787582825.474348:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162104576 00000100:00100000:0.0:1787582825.474421:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 45 00000100:00100000:0.0:1787582825.474432:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162104576:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787582825.474720:0:8218:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787582825.474724:0:8218:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787582825 -> 1787582824 00002000:00010000:0.0:1787582825.474728:0:8218:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787582824 00002000:00010000:0.0:1787582825.474730:0:8218:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787582825 -> 1787582824 00002000:00010000:0.0:1787582825.474733:0:8218:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787582825.474807:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2359:x1874416162104576:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 Request processed in 376us (566us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787582825.474816:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 45 00000100:00100000:1.0:1787582825.478152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582825.478354:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162104832 00000100:00100000:0.0:1787582825.478368:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162104832 00000100:00100000:0.0:1787582825.478533:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 126 00000100:00100000:0.0:1787582825.478546:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:10561:x1874416162104832:12345-192.168.206.20@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787582825.478643:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75384e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.478664:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75384a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58153 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.478676:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75384e8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.478720:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75384a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58153 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.478737:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75384a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58153 expref: 15 pid: 5855 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582825.478774:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da586c7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1874416186233216:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582825.478911:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b51f0600 going to sleep for 11 seconds 00000100:00100000:2.0:1787582825.483794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582825.484146:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162104960 00000100:00100000:3.0:1787582825.484160:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162104960 00010000:00010000:3.0:1787582825.484213:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75384a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58153 expref: 16 pid: 5855 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582825.484308:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 58 00000100:00100000:3.0:1787582825.484345:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+16:2360:x1874416162104960:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582825.484363:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582825.484371:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75384a2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58153 expref: 16 pid: 5855 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.484387:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75384a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58153 expref: 16 pid: 5855 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.484429:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:3.0:1787582825.484435:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75384e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.484446:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75384e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.484455:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75384e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.484480:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582825.484614:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+16:2360:x1874416162104960:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 295us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582825.484624:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 58 00010000:00010000:0.0:1787582825.485239:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75384a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58153 expref: 15 pid: 5855 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582825.485582:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da586c7f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1874416186233216:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582825.485615:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75384e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.485627:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75384e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.485632:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75384e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.485819:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75384e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.485827:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75384e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.485833:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75384e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.485839:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20eee00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582825.485843:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75384e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.485870:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75384e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.486178:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:0.0:1787582825.486181:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787582825.486186:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75384e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.486192:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75384e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582825.486598:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:10561:x1874416162104832:12345-192.168.206.20@tcp:55:lhsmtool_posix.0 Request processed in 8052us (9211us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787582825.486610:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 126 00000100:00100000:3.0:1787582825.490642:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582825.490813:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162105088 00000100:00100000:1.0:1787582825.490827:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162105088 00000100:00100000:1.0:1787582825.491185:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 46 00000100:00100000:1.0:1787582825.491199:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2359:x1874416162105088:12345-192.168.206.20@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787582825.491269:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c35597a0/0xa113d808b75384ef lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.491304:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000784d5c68/0xa113d808b75384cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5816f expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.491359:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582825.491366:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787582825.491373:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c35597a0/0xa113d808b75384ef lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.491429:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000784d5c68/0xa113d808b75384cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5816f expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.491448:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000784d5c68/0xa113d808b75384cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5816f expref: 7 pid: 6705 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582825.491493:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1874416186233344:192.168.206.20@tcp:104: 00000100:00100000:1.0:1787582825.491601:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5ab9303c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582825.495949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582825.496121:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162105216 00000100:00100000:3.0:1787582825.496142:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162105216 00010000:00010000:3.0:1787582825.496216:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000784d5c68/0xa113d808b75384cc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5816f expref: 8 pid: 6705 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582825.496350:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 59 00000100:00100000:3.0:1787582825.496363:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2359:x1874416162105216:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582825.496381:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582825.496412:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000784d5c68/0xa113d808b75384cc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5816f expref: 8 pid: 6705 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.496443:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000784d5c68/0xa113d808b75384cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5816f expref: 8 pid: 6705 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.496482:0:8463:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787582825.496496:0:8463:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787582825.496504:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c35597a0/0xa113d808b75384ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.496515:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c35597a0/0xa113d808b75384ef lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.496551:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582825.496644:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2359:x1874416162105216:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 258us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582825.496653:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 59 00010000:00010000:1.0:1787582825.496951:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000784d5c68/0xa113d808b75384cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5816f expref: 7 pid: 6705 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582825.496971:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6704:1874416186233344:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582825.496999:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c35597a0/0xa113d808b75384ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.497011:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c35597a0/0xa113d808b75384ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.497019:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c35597a0/0xa113d808b75384ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.497066:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c35597a0/0xa113d808b75384ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.497076:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c35597a0/0xa113d808b75384ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.497085:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c35597a0/0xa113d808b75384ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.497109:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7c00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:1.0:1787582825.497114:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c35597a0/0xa113d808b75384ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.497125:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c35597a0/0xa113d808b75384ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.497142:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c35597a0/0xa113d808b75384ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.497150:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c35597a0/0xa113d808b75384ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582825.497255:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162105088:12345-192.168.206.20@tcp:1:lhsmtool_posix.0 Request processed in 6059us (6627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582825.497264:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 46 00000100:00100000:2.0:1787582825.509377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582825.509490:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162105472 00000100:00100000:1.0:1787582825.509503:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162105472 00000100:00100000:1.0:1787582825.509587:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 127 00000100:00100000:1.0:1787582825.509600:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:10561:x1874416162105472:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787582825.509700:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75384f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.509720:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75384f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.509754:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75384f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.509994:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75384fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.510007:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b75384b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5815a expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.510015:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75384fd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.510124:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b75384b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5815a expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.510141:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b75384b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5815a expref: 15 pid: 5854 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582825.510159:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186233472:192.168.206.20@tcp:104: 00000100:00100000:1.0:1787582825.510354:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5ab9303c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582825.518180:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186233472:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582825.518221:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75384fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582825.528607:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582825.534043:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162105600 00000100:00100000:3.0:1787582825.534065:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162105600 00010000:00010000:3.0:1787582825.534139:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b75384b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5815a expref: 16 pid: 5854 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582825.534224:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 60 00000100:00100000:3.0:1787582825.534235:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+16:2359:x1874416162105600:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582825.534269:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582825.534288:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b75384b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5815a expref: 16 pid: 5854 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.534305:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b75384b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5815a expref: 16 pid: 5854 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.534380:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b75384b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5815a expref: 16 pid: 5854 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.534410:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:3.0:1787582825.534418:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75384fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.534429:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75384fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.534437:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75384fd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582825.534474:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787582825.534522:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75384fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.534535:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75384fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582825.534565:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:2359:x1874416162105600:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 330us (5971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582825.534574:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 60 00000001:00080000:1.0:1787582825.534777:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1787582825.535047:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1787582825.535101:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1787582825.535193:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874416186233600:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787582825.535263:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582825.535310:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5ab930f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787582825.535923:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186233600 00000100:00100000:3.0:1787582825.535946:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186233600 00000100:00100000:3.0:1787582825.536014:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787582825.536659:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1874416186233600:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787582825.536781:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1874416186233600:12345-0@lo:1000:mdt00_000.0 Request processed in 128us (1516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582825.536789:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787582825.538616:0:5852:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1787582825.538632:0:5852:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1787582825.538659:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8da58b3ec000, transno 4294967309 00000100:00100000:1.0:1787582825.538680:0:5852:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8da58b3ed880 x1874416186232832/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787582841 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582825.538696:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874416186233600:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787582825.539411:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787582825.542000:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b35d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874416186233728:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787582825.542094:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582825.542141:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5ab9303c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582825.542210:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186233728 00000100:00100000:0.0:1787582825.542221:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186233728 00000100:00100000:0.0:1787582825.542310:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787582825.542340:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1874416186233728:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787582825.542650:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5852:x1874416186233728:12345-0@lo:1000:mdt00_000.0 Request processed in 312us (555us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787582825.542661:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787582825.542690:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b35d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874416186233728:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787582825.542740:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75384fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.542752:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75384fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.542760:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75384fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.542767:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582825.542789:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75384fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.542798:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75384fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.542819:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:1.0:1787582825.542822:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787582825.542827:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75384fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.542835:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75384fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.542892:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538440 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.542899:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538440 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.542904:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538440 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.542910:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582825.542913:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538440 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.542919:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538440 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.542929:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:1.0:1787582825.542931:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787582825.542945:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538447 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5813e expref: 18 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.542959:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538447 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5813e expref: 18 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.543193:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538447 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5813e expref: 18 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.543230:0:5852:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538447 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5813e expref: 18 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582825.543244:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b35df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186233856:192.168.206.20@tcp:105: 00000100:00100000:1.0:1787582825.543724:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5ab9303c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582825.552640:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186234368:0@lo:400:kworker.0 00000100:00100000:2.0:1787582825.552659:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186234112:0@lo:400:kworker.0 00000100:00100000:0.0:1787582825.552694:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186233984:0@lo:400:kworker.0 00000100:00100000:3.0:1787582825.552712:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186234240:0@lo:400:kworker.0 00000100:00100000:2.0:1787582825.554947:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582825.555211:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582825.555246:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582825.555246:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162105728 00000100:00100000:2.0:1787582825.555256:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162105728 00000100:00100000:2.0:1787582825.555346:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 31 00000100:00100000:2.0:1787582825.555358:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:10560:x1874416162105728:12345-192.168.206.20@tcp:49:lfs.0 00000100:00100000:2.0:1787582825.555653:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:10560:x1874416162105728:12345-192.168.206.20@tcp:49:lfs.0 Request processed in 296us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582825.555662:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 31 00000100:00100000:2.0:1787582825.556001:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186234112 00000100:00100000:2.0:1787582825.556006:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186234112 00000100:00100000:2.0:1787582825.556175:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186234240 00000100:00100000:2.0:1787582825.556180:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186234240 00000100:00100000:2.0:1787582825.556218:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787582825.556225:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186234112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582825.556398:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582825.556455:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186233984 00000100:00100000:0.0:1787582825.556459:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186233984 00000100:00100000:0.0:1787582825.556496:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787582825.556503:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186234112:12345-0@lo:400:kworker.0 Request processed in 276us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582825.556508:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3313:x1874416186233984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582825.556558:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3313:x1874416186233984:12345-0@lo:400:kworker.0 Request processed in 54us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582825.556565:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787582825.556607:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582825.556622:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186233984:0@lo:400:kworker.0 00000100:00100000:1.0:1787582825.556649:0:5854:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787582825.556659:0:5854:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1787582825.557728:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787582825.557759:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186234368 00000100:00100000:2.0:1787582825.557767:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186234368 00000100:00100000:2.0:1787582825.557803:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787582825.557812:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186234240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582825.557901:0:7653:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787582825.557901:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b35df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186233856:192.168.206.20@tcp:105: 00000100:00100000:3.0:1787582825.557912:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787582825.557919:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186234368:12345-0@lo:400:kworker.0 00010000:00010000:1.0:1787582825.557935:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538440 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.557947:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b7538440 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.557988:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b7538504 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558005:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b7538504 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558215:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b7538504 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558227:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b7538504 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558233:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b7538504 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558239:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b7538504 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558245:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582825.558250:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b7538504 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558258:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b7538504 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558271:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:1.0:1787582825.558283:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582825.558288:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b7538504 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558293:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b7538504 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558305:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75384f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558311:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75384f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558345:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75384f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558350:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582825.558353:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75384f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558360:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75384f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558369:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:1.0:1787582825.558371:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787582825.558374:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75384f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582825.558380:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75384f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582825.558489:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186234240:12345-0@lo:400:kworker.0 Request processed in 676us (3241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582825.558497:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1787582825.558599:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787582825.558637:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186234240:0@lo:400:kworker.0 00000100:00100000:2.0:1787582825.558709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582825.558733:0:5855:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787582825.558739:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162105984 00000100:00100000:2.0:1787582825.558744:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162105984 00000100:00100000:2.0:1787582825.558763:0:5855:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787582825.558771:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 128 00000100:00100000:2.0:1787582825.558778:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:10560:x1874416162105984:12345-192.168.206.20@tcp:58:lfs.0 00000040:00080000:1.0:1787582825.559901:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787582825.559908:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787582825.560554:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:10561:x1874416162105472:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 50946us (51234us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787582825.560569:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 127 00000020:00080000:0.0:1787582825.560576:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787582825.562452:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787582825.562476:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787582825.563080:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787582825.563230:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:10560:x1874416162105984:12345-192.168.206.20@tcp:58:lfs.0 Request processed in 4443us (4513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582825.563245:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 128 00000100:00100000:2.0:1787582825.563376:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186234112:0@lo:400:kworker.0 00000100:00100000:3.0:1787582825.564800:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186234368:12345-0@lo:400:kworker.0 Request processed in 6873us (8185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582825.564814:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787582825.564895:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186234368:0@lo:400:kworker.0 00000100:00100000:2.0:1787582825.570777:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582825.575489:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162106240 00000100:00100000:1.0:1787582825.575510:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162106240 00000100:00100000:1.0:1787582825.575653:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 32 00000100:00100000:1.0:1787582825.575666:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583667450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:10561:x1874416162106240:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787582825.577207:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787582825.577393:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787582825.577478:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753850b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.577498:0:5857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753850b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.577514:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753850b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.577526:0:5857:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753850b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.577533:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753850b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.577541:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753850b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.577574:0:5857:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787582825.577745:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583667450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+20:10561:x1874416162106240:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 Request processed in 2072us (6974us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787582825.577767:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 32 00000020:00080000:0.0:1787582825.577775:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787582825.578239:0:11179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582825.578267:0:11179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753850b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.578287:0:11179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ef800 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582825.578293:0:11179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753850b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.578301:0:11179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753850b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.578362:0:11179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8da5a0b68b00) 00010000:00010000:2.0:1787582825.578368:0:11179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787582825.578374:0:11179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753850b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.578380:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef800/0xa113d808b753850b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.578408:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582825.578411:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582825.578413:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582825.619539:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582825.619824:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162106368 00000100:00100000:2.0:1787582825.619838:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162106368 00000100:00100000:2.0:1787582825.619963:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 129 00000100:00100000:2.0:1787582825.619976:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+20:10563:x1874416162106368:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582825.620011:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582825.620037:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538512 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58176 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.620119:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538519 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.620165:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538519 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.620179:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538519 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.620204:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538520 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.620211:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.620218:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.620623:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.620636:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58137 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.620645:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538527 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.620685:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58137 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.620703:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58137 expref: 21 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582825.620732:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1874416186234496:192.168.206.20@tcp:104: 00000100:00100000:2.0:1787582825.620851:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a169b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787582825.627504:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1874416186234496:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582825.627552:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582825.628402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582825.628493:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162106624 00000100:00100000:2.0:1787582825.628504:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162106624 00000100:00100000:2.0:1787582825.628966:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 33 00000100:00100000:2.0:1787582825.628980:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+22:5596:x1874416162106624:12345-192.168.206.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787582825.629382:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+23:5596:x1874416162106624:12345-192.168.206.20@tcp:35:ldlm_bl.0 Request processed in 402us (984us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787582825.629400:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 33 00000100:00100000:2.0:1787582825.637442:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582825.637932:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162106752 00000100:00100000:0.0:1787582825.637950:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162106752 00010000:00010000:0.0:1787582825.638024:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58137 expref: 23 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582825.638089:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 61 00000100:00100000:0.0:1787582825.638102:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5911a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+23:2360:x1874416162106752:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787582825.638123:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582825.638132:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58137 expref: 23 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.638148:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58137 expref: 23 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.638179:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7538432 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58137 expref: 23 pid: 5852 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.638202:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:0.0:1787582825.638209:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.638222:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.638232:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538527 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582825.638298:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582825.639005:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5911a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+22:2360:x1874416162106752:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 900us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582825.639020:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 61 00010000:00010000:2.0:1787582825.639140:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.639151:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582825.639205:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787582825.639210:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787582825.639233:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.639250:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.639260:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538519 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.639267:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538519 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.639293:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538519 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.639301:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9ee00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582825.639306:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538519 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.640444:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538519 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.640478:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:2.0:1787582825.640482:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582825.640489:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538519 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.640496:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b7538519 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.640870:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538520 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.640879:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538520 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.640886:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538520 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.640892:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9ec00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582825.640896:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538520 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.641022:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538520 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.641033:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8da5a4492600) 00010000:00010000:2.0:1787582825.641035:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582825.641039:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538520 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.641045:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7538520 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.641102:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538512 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58176 expref: 22 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.641117:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58176 expref: 21 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582825.641125:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:2.0:1787582825.641127:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787582825.641130:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9f400, rc 0) 00000100:00100000:2.0:1787582825.641217:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+21:10563:x1874416162106368:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 21243us (21690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582825.641228:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 129 00010000:00010000:2.0:1787582825.936747:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582826.064756:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186234624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787582826.064874:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582826.065206:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186234624 00000100:00100000:1.0:1787582826.065217:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186234624 00000100:00100000:1.0:1787582826.065310:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787582826.065361:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874416186234624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787582826.065406:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787582826.068388:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787582826.068898:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874416186234624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3532us (4030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582826.068914:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787582826.079227:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186234624:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787582826.580787:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787582826.580801:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787582826.580849:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787582826.580858:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787582826.581018:0:11695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11695:1874416186234752:192.168.206.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787582826.581143:0:11695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a08cb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582826.587502:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582826.587924:0:11695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11695:1874416186234752:192.168.206.20@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787582826.588812:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162106880 00000100:00100000:1.0:1787582826.588825:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162106880 00000100:00100000:1.0:1787582826.588930:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 130 00000100:00100000:1.0:1787582826.588944:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+21:10574:x1874416162106880:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787582826.588990:0:5852:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787582826.589186:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+21:10574:x1874416162106880:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 Request processed in 245us (1701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582826.589196:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 130 00000100:00100000:2.0:1787582826.594402:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582826.594449:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162107136 00000100:00100000:0.0:1787582826.594462:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162107136 00000100:00100000:0.0:1787582826.594538:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 131 00000100:00100000:0.0:1787582826.594550:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+21:10574:x1874416162107136:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787582826.594575:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582826.594600:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753852e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5817d expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582826.594723:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538535 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582826.594741:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582826.594757:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582826.594784:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787582826.594946:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753852e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5817d expref: 24 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582826.594978:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5817d expref: 23 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582826.594988:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:0.0:1787582826.594991:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582826.594994:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ee200, rc 0) 00000100:00100000:0.0:1787582826.595065:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+23:10574:x1874416162107136:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 517us (677us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1787582826.595073:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 131 00000100:00100000:1.0:1787582826.600719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582826.600847:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162107264 00000100:00100000:2.0:1787582826.600860:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162107264 00000100:00100000:1.0:1787582826.601667:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582826.601698:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162107520 00000100:00100000:1.0:1787582826.601704:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162107520 00000100:00100000:1.0:1787582826.601753:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 132 00000100:00100000:1.0:1787582826.601772:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+24:10574:x1874416162107520:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787582826.601874:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538543 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582826.601894:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582826.601908:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582826.602396:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 8 00000100:00100000:2.0:1787582826.602409:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+25:2358:x1874416162107264:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582826.602423:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582826.602446:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538535 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5817d expref: 25 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582826.602467:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:2.0:1787582826.602474:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582826.602553:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+24:2358:x1874416162107264:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 147us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582826.602562:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 8 00010000:00010000:1.0:1787582826.603865:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582826.603881:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538543 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582826.603890:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538543 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582826.603897:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582826.603902:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538543 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582826.603911:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538543 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582826.603927:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:1.0:1787582826.603930:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787582826.603934:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538543 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582826.603940:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538543 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582826.604153:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+23:10574:x1874416162107520:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 2378us (2485us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787582826.604163:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 132 00000040:00080000:2.0:1787582826.604599:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787582826.604606:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787582826.606444:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787582826.606466:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787582826.608173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582826.608344:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162107776 00000100:00100000:2.0:1787582826.608357:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162107776 00000100:00100000:2.0:1787582826.608426:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 34 00000100:00100000:2.0:1787582826.608438:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+23:10574:x1874416162107776:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787582826.608738:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+24:10574:x1874416162107776:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 Request processed in 300us (575us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787582826.608754:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 34 00000040:00080000:0.0:1787582826.655661:0:12121:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787582826.655671:0:12121:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787582826.655817:0:12121:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787582826.655824:0:12121:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787582826.857559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582826.865015:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162108032 00000100:00100000:1.0:1787582826.865035:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162108032 00000100:00100000:1.0:1787582826.865120:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 133 00000100:00100000:1.0:1787582826.865133:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+24:10587:x1874416162108032:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:1.0:1787582826.865167:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582826.865197:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b753854a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58184 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582826.865362:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b7538551 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582826.865379:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b7538551 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582826.865392:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b7538551 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582826.865405:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787582826.865543:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b753854a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58184 expref: 27 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582826.865559:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b7538551 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58184 expref: 26 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582826.865576:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:1.0:1787582826.865578:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787582826.865581:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6000, rc 0) 00000100:00100000:1.0:1787582826.865648:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:10587:x1874416162108032:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 519us (8105us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787582826.865653:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 133 00000100:00100000:3.0:1787582826.874226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582826.874371:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162108160 00000100:00100000:0.0:1787582826.874383:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162108160 00000100:00100000:0.0:1787582826.874458:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 134 00000100:00100000:0.0:1787582826.874471:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:10587:x1874416162108160:12345-192.168.206.20@tcp:54:lfs.0 00010000:00010000:0.0:1787582826.874560:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753855f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582826.874582:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753855f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582826.874596:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753855f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582826.874644:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753855f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582826.874651:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753855f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582826.874658:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753855f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582826.874665:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582826.874669:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753855f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582826.874677:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753855f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582826.874691:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:0.0:1787582826.874694:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787582826.874699:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753855f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582826.874706:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b753855f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582826.874804:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:10587:x1874416162108160:12345-192.168.206.20@tcp:54:lfs.0 Request processed in 335us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582826.874814:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 134 00010000:00010000:0.0:1787582826.960530:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582826.999577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582826.999971:0:12082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162108288 00000100:00100000:0.0:1787582826.999983:0:12082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162108288 00000100:00100000:0.0:1787582827.000074:0:12082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 47 00000100:00100000:0.0:1787582827.000086:0:12082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162108288:12345-192.168.206.20@tcp:101:cat.0 00010000:00010000:0.0:1787582827.000109:0:12082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582827.000136:0:12082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e080ccaf/0xa113d808b7538566 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5818b expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787582827.000170:0:12082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c5968, atime: 0x6a8c5968, ctime: 0x6a8c5968, blocks: 0xb 00010000:00010000:0.0:1787582827.000196:0:12082:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=368s v=(0 0) 00010000:00010000:0.0:1787582827.000201:0:12082:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582827.000214:0:12082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e080ccaf/0xa113d808b7538566 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5818b expref: 7 pid: 12082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582827.000237:0:12082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e080ccaf/0xa113d808b7538566 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5818b expref: 7 pid: 12082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582827.000253:0:12082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ef800, rc 0) 00000100:00100000:0.0:1787582827.000363:0:12082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2359:x1874416162108288:12345-192.168.206.20@tcp:101:cat.0 Request processed in 279us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582827.000371:0:12082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 47 00000100:00100000:2.0:1787582827.012873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582827.012931:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162108416 00000100:00100000:0.0:1787582827.012944:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162108416 00002000:00100000:0.0:1787582827.013027:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8da5adbf4380 x1874416162108416/t0(0) o3->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:293/0 lens 488/0 e 0 to 0 dl 1787582838 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787582827.013038:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5adbf4380 with x1874416162108416 ext(0->4095) 00002000:00010000:0.0:1787582827.013045:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da5adbf4380 00000100:00100000:0.0:1787582827.013083:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 3 00000100:00100000:0.0:1787582827.013113:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2358:x1874416162108416:12345-192.168.206.20@tcp:3:cat.0 00000100:00100000:0.0:1787582827.013464:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2358:x1874416162108416:12345-192.168.206.20@tcp:3:cat.0 Request processed in 352us (602us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787582827.013473:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 3 00002000:00100000:0.0:1787582827.013480:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8da5adbf4380 x1874416162108416/t0(0) o3->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:293/0 lens 488/4536 e 0 to 0 dl 1787582838 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787582827.013489:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5adbf4380 with x1874416162108416 ext(0->4095) 00002000:00010000:0.0:1787582827.013492:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da5adbf4380 00000100:00080000:3.0:1787582827.013691:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787582827.985705:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787582828.709918:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1787582828.709943:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:3.0:1787582829.009458:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582829.536667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582829.537018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582829.537061:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582829.537097:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162109056 00000100:00100000:2.0:1787582829.537110:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162109056 00000100:00100000:2.0:1787582829.537185:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 140 00000100:00100000:2.0:1787582829.537198:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162109056:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582829.537309:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162109056:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 114us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582829.537341:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 140 00000100:00080000:2.0:1787582829.537533:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582829.539354:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162108800 00000100:00100000:1.0:1787582829.539379:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162108800 00000100:00100000:1.0:1787582829.539456:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 75 00000100:00100000:1.0:1787582829.539587:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2357:x1874416162108800:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582829.539669:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2357:x1874416162108800:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 203us (2651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582829.539677:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 75 00000100:00080000:2.0:1787582829.539773:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787582829.539830:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582829.539973:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582829.540304:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162108672 00000100:00100000:1.0:1787582829.540310:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162108672 00000100:00100000:1.0:1787582829.540384:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 141 00000100:00100000:1.0:1787582829.540392:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:2358:x1874416162108672:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582829.540438:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:2358:x1874416162108672:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 46us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582829.540445:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 141 00000100:00100000:1.0:1787582829.540463:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162108928 00000100:00100000:1.0:1787582829.541455:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162108928 00000100:00100000:1.0:1787582829.541528:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 76 00000100:00100000:1.0:1787582829.541537:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162108928:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582829.541596:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162108928:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 60us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582829.541604:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 76 00000100:00080000:2.0:1787582829.541853:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787582829.541858:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582829.542000:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162108544 00000100:00100000:0.0:1787582829.542007:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162108544 00000100:00100000:0.0:1787582829.542927:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 290 00000100:00100000:0.0:1787582829.542941:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58923d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2357:x1874416162108544:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582829.543013:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58923d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2357:x1874416162108544:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 75us (6360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582829.543021:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 290 00000100:00100000:1.0:1787582829.656530:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582829.661514:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186234880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582829.661589:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582829.661836:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186234880 00000100:00100000:2.0:1787582829.661844:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186234880 00000100:00100000:2.0:1787582829.661915:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787582829.661925:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874416186234880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582829.661973:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582829.662033:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874416186234880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582829.662051:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787582829.662527:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186234880:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787582829.665288:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787582830.032562:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582830.696032:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186235008:0@lo:400:kworker.0 00000100:00100000:2.0:1787582830.696091:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582830.696150:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186235008 00000100:00100000:2.0:1787582830.696157:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186235008 00000100:00100000:2.0:1787582830.696191:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787582830.696198:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186235008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582830.696238:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186235008:12345-0@lo:400:kworker.0 Request processed in 40us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582830.696245:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1787582830.696300:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186235008:0@lo:400:kworker.0 00000100:00100000:0.0:1787582830.719956:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874416186235392:0@lo:400:kworker.0 00000100:00100000:0.0:1787582830.720018:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582830.720052:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787582830.720058:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186235264:0@lo:400:kworker.0 00000100:00100000:0.0:1787582830.720084:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582830.720116:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186235392 00000100:00100000:0.0:1787582830.720122:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186235392 00000100:00100000:0.0:1787582830.720175:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787582830.720183:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874416186235392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582830.720232:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874416186235392:12345-0@lo:400:kworker.0 Request processed in 51us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582830.720239:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1787582830.720267:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582830.724210:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874416186235392:0@lo:400:kworker.0 00000100:00100000:3.0:1787582830.728170:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186235520:0@lo:400:kworker.0 00000100:00100000:3.0:1787582830.728255:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582830.728291:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787582830.728298:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186235136:0@lo:400:kworker.0 00000100:00100000:3.0:1787582830.728341:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582830.728361:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186235648:0@lo:400:kworker.0 00000100:00100000:3.0:1787582830.729503:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582830.731424:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186235520 00000100:00100000:1.0:1787582830.731437:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186235520 00000100:00100000:1.0:1787582830.731492:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186235136 00000100:00100000:1.0:1787582830.731494:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186235136 00000100:00100000:1.0:1787582830.731515:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787582830.731523:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186235520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582830.731598:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186235520:12345-0@lo:400:kworker.0 Request processed in 76us (3353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582830.731605:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787582830.731618:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787582830.731623:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186235136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582830.731644:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186235136:12345-0@lo:400:kworker.0 Request processed in 22us (3304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582830.731650:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787582830.731666:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186235264 00000100:00100000:1.0:1787582830.731669:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186235264 00000100:00100000:1.0:1787582830.731687:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186235648 00000100:00100000:1.0:1787582830.731690:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186235648 00000100:00100000:1.0:1787582830.731704:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787582830.731709:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1874416186235264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582830.731749:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1874416186235264:12345-0@lo:400:kworker.0 Request processed in 39us (11664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582830.731755:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787582830.731765:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787582830.731770:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186235648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582830.731791:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186235648:12345-0@lo:400:kworker.0 Request processed in 21us (2291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582830.731796:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787582830.731807:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787582830.731811:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582830.731842:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186235136:0@lo:400:kworker.0 00000100:00100000:1.0:1787582830.731852:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787582830.731857:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1787582830.731873:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8da5adbf7480, transno 4294967304 00000100:00100000:1.0:1787582830.731885:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186235648:0@lo:400:kworker.0 00000100:00100000:1.0:1787582830.731895:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186235520:0@lo:400:kworker.0 00000100:00100000:1.0:1787582830.731929:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186235264:0@lo:400:kworker.0 00000001:00080000:0.0:1787582830.783211:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:0.0:1787582830.783296:0:5876:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1787582830.783334:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1787582830.783350:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8da5ab930f00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787582830.783354:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da5892b1900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8da5ab930180 00000020:00080000:0.0:1787582830.783358:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da5892b1000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8da5bf8fbc00 00000020:00080000:1.0:1787582830.787414:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1787582830.787591:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1787582830.860439:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1787582830.860454:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:3.0:1787582831.056594:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582831.191025:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186235776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787582831.191165:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582831.191286:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186235776 00000100:00100000:2.0:1787582831.191295:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186235776 00000100:00100000:2.0:1787582831.195603:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787582831.195622:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186235776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787582831.195664:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582831.195760:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186235776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (4594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582831.195766:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787582831.195790:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186235776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787582831.473447:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582831.473779:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162109184 00000100:00100000:3.0:1787582831.473789:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162109184 00000100:00100000:3.0:1787582831.473866:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 135 00000100:00100000:3.0:1787582831.473877:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10240:x1874416162109184:12345-192.168.206.20@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787582831.473985:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10240:x1874416162109184:12345-192.168.206.20@tcp:60:lhsmtool_posix.0 Request processed in 99us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582831.473993:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 135 00000100:00080000:1.0:1787582831.474874:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582831.491566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582831.492947:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162109440 00000100:00100000:3.0:1787582831.492960:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162109440 00000100:00100000:3.0:1787582831.493031:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 35 00000100:00100000:3.0:1787582831.493042:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:10240:x1874416162109440:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787582831.493551:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:10240:x1874416162109440:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 Request processed in 509us (1993us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787582831.493559:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 35 00000100:00100000:3.0:1787582831.740054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582831.745138:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162109568 00000100:00100000:1.0:1787582831.745154:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162109568 00000100:00100000:1.0:1787582831.745237:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 136 00000100:00100000:1.0:1787582831.745259:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83345526-3920-4b94-b598-4d9f74280322+5:11039:x1874416162109568:12345-192.168.206.20@tcp:101:lsof.0 00010000:00010000:1.0:1787582831.745291:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582831.745311:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b753856d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58192 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582831.745402:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538574 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582831.745417:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538574 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582831.745427:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538574 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582831.745625:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787582831.745629:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582831.745725:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538574 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582831.745752:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b753856d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58192 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582831.745768:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538574 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58192 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582831.745776:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492100) 00010000:00010000:1.0:1787582831.745779:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787582831.745782:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6200, rc 0) 00000100:00100000:1.0:1787582831.745838:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:83345526-3920-4b94-b598-4d9f74280322+6:11039:x1874416162109568:12345-192.168.206.20@tcp:101:lsof.0 Request processed in 581us (5793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582831.745845:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 136 00000100:00080000:0.0:1787582831.746009:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787582831.760662:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787582831.760671:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787582831.760711:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787582831.760718:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787582832.080895:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582833.104544:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582834.128557:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582834.650881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582834.650935:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582834.650946:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162109696 00000100:00100000:0.0:1787582834.650956:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162109696 00000100:00100000:3.0:1787582834.650975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582834.651003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582834.651008:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 292 00000100:00100000:0.0:1787582834.651018:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2358:x1874416162109696:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582834.651026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582834.651044:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162110208 00000100:00100000:3.0:1787582834.651047:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162110208 00000100:00100000:0.0:1787582834.651079:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2358:x1874416162109696:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 62us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582834.651080:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162109824 00000100:00100000:3.0:1787582834.651082:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162109824 00000100:00100000:0.0:1787582834.651086:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 292 00000100:00100000:3.0:1787582834.651099:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 145 00000100:00100000:3.0:1787582834.651106:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83345526-3920-4b94-b598-4d9f74280322+6:2358:x1874416162110208:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582834.651135:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83345526-3920-4b94-b598-4d9f74280322+6:2358:x1874416162110208:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 29us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582834.651140:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 145 00000100:00100000:3.0:1787582834.651152:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 146 00000100:00100000:3.0:1787582834.651158:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:2358:x1874416162109824:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582834.651186:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:2358:x1874416162109824:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 28us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582834.651192:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 146 00000100:00080000:3.0:1787582834.651235:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582834.651292:0:12082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162109952 00000100:00100000:1.0:1787582834.651297:0:12082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162109952 00000100:00100000:1.0:1787582834.651369:0:12082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162110080 00000100:00100000:1.0:1787582834.651372:0:12082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162110080 00000100:00100000:1.0:1787582834.651395:0:12082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 79 00000100:00100000:1.0:1787582834.651402:0:12082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162109952:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582834.651437:0:12082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2358:x1874416162109952:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 35us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582834.651443:0:12082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 79 00000100:00100000:1.0:1787582834.651455:0:12082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 80 00000100:00100000:1.0:1787582834.651461:0:12082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162110080:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582834.651485:0:12082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162110080:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582834.651491:0:12082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 80 00000100:00080000:3.0:1787582834.651722:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787582834.651726:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582834.768726:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186235904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787582834.768796:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582834.768917:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186235904 00000100:00100000:2.0:1787582834.768925:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186235904 00000100:00100000:2.0:1787582834.768987:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787582834.768998:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186235904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582834.769028:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582834.769085:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186235904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582834.769104:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1787582834.769158:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787582834.769175:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1787582834.769181:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8da58b3ed880, transno 4294967310 00000004:00080000:0.0:1787582834.769205:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1787582834.769385:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186235904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787582835.152526:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582835.797111:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb5fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186236288:0@lo:400:kworker.0 00000100:00100000:3.0:1787582835.797187:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582835.797268:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787582835.797275:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb5fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186236416:0@lo:400:kworker.0 00000100:00100000:3.0:1787582835.797303:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582835.809473:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186236288 00000100:00100000:2.0:1787582835.809487:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186236288 00000100:00100000:2.0:1787582835.809539:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787582835.809550:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186236288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582835.809641:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186236288:12345-0@lo:400:kworker.0 Request processed in 92us (12453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582835.809647:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787582835.809691:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb5fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186236288:0@lo:400:kworker.0 00000100:00100000:2.0:1787582835.809722:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186236416 00000100:00100000:2.0:1787582835.809726:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186236416 00000100:00100000:2.0:1787582835.810352:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787582835.810362:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186236416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582835.810407:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186236416:12345-0@lo:400:kworker.0 Request processed in 47us (13103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582835.810414:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1787582835.810432:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582835.813631:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb5fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186236032:0@lo:400:kworker.0 00000100:00100000:1.0:1787582835.813699:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582835.813756:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb5fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186236544:0@lo:400:kworker.0 00000100:00100000:1.0:1787582835.813787:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582835.813815:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787582835.813823:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb5fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186236160:0@lo:400:kworker.0 00000100:00100000:1.0:1787582835.813846:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582835.813865:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb5fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186236672:0@lo:400:kworker.0 00000100:00100000:1.0:1787582835.813888:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582835.813921:0:12082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186236672 00000100:00100000:1.0:1787582835.813928:0:12082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186236672 00000100:00100000:1.0:1787582835.814002:0:12082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787582835.814011:0:12082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186236672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582835.814063:0:12082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186236672:12345-0@lo:400:kworker.0 Request processed in 53us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582835.814070:0:12082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787582835.814372:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186236032 00000100:00100000:1.0:1787582835.814377:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186236032 00000100:00100000:1.0:1787582835.814406:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787582835.814414:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186236032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582835.814447:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186236032:12345-0@lo:400:kworker.0 Request processed in 34us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582835.814454:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787582835.814480:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186236544 00000100:00100000:1.0:1787582835.814484:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186236544 00000100:00100000:1.0:1787582835.814509:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186236160 00000100:00100000:1.0:1787582835.814512:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186236160 00000100:00100000:1.0:1787582835.814532:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787582835.814539:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186236544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582835.814569:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186236544:12345-0@lo:400:kworker.0 Request processed in 31us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582835.814575:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787582835.814587:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787582835.814594:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186236160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582835.814620:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186236160:12345-0@lo:400:kworker.0 Request processed in 27us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582835.814625:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1787582835.814647:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787582835.814657:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787582835.814699:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb5fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186236160:0@lo:400:kworker.0 00000100:00100000:1.0:1787582835.814711:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb5fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186236672:0@lo:400:kworker.0 00000100:00100000:1.0:1787582835.814719:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb5fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186236032:0@lo:400:kworker.0 00000100:00100000:1.0:1787582835.814728:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb5fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186236544:0@lo:400:kworker.0 00000100:00100000:3.0:1787582835.815397:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb5fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186236416:0@lo:400:kworker.0 00000020:00080000:0.0:1787582835.910400:0:5876:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1787582835.910441:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1787582835.918708:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787582835.918724:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1787582836.176558:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582836.306571:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787582836.306590:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da589c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186236800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787582836.306646:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582836.306694:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186236800 00000100:00100000:0.0:1787582836.306700:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186236800 00000100:00100000:0.0:1787582836.306736:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787582836.306744:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186236800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787582836.306771:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582836.306806:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186236800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582836.306813:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787582836.306852:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da589c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186236800:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787582836.430721:0:12324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:47:15 (1787582835) 00010000:00010000:3.0:1787582837.201856:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582838.224909:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582839.019120:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582839.019285:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162110464 00000100:00100000:1.0:1787582839.019296:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162110464 00000100:00100000:1.0:1787582839.019403:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 137 00000100:00100000:1.0:1787582839.019413:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:11304:x1874416162110464:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787582839.019433:0:12083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582839.019451:0:12083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b753857b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58199 expref: -99 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.019518:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538582 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.019532:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538582 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.019545:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538582 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.019559:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538589 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.019566:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538589 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.019585:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538589 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.019976:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538590 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.019986:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538590 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.019994:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538590 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582839.020003:0:12083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787582839.020224:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538582 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020232:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538582 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020238:0:12083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538582 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020244:0:12083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582839.020248:0:12083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538582 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020255:0:12083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538582 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020267:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8da5a4492e00) 00010000:00010000:1.0:1787582839.020270:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582839.020281:0:12083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538582 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020290:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538582 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020303:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538589 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020309:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538589 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020315:0:12083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538589 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020365:0:12083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582839.020369:0:12083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538589 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020376:0:12083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538589 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020384:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8da58533fa00) 00010000:00010000:1.0:1787582839.020387:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582839.020390:0:12083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538589 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020396:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538589 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020752:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b753857b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58199 expref: 16 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020776:0:12083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538590 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58199 expref: 15 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582839.020783:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8da5a0b68e00) 00010000:00010000:1.0:1787582839.020785:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582839.020788:0:12083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6600, rc 0) 00000100:00100000:1.0:1787582839.020842:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:11304:x1874416162110464:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 1430us (1730us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787582839.020850:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 137 00000100:00080000:2.0:1787582839.021247:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582839.043636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582839.043690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582839.043794:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162110720 00000100:00100000:0.0:1787582839.043803:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162110720 00000100:00100000:0.0:1787582839.043868:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:0.0:1787582839.043878:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:2360:x1874416162110720:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787582839.043891:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582839.043914:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538590 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58199 expref: 15 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582839.043933:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8da5a0b68e00) 00010000:00010000:0.0:1787582839.043937:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582839.044013:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:2360:x1874416162110720:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 136us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582839.044021:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:2.0:1787582839.044160:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162110592 00000100:00100000:2.0:1787582839.044165:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162110592 00000100:00100000:2.0:1787582839.044219:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 138 00000100:00100000:2.0:1787582839.044227:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:11304:x1874416162110592:12345-192.168.206.20@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787582839.044291:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:11304:x1874416162110592:12345-192.168.206.20@tcp:59:lhsmtool_posix.0 Request processed in 65us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582839.044299:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 138 00010000:00010000:3.0:1787582839.248479:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582839.767743:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582839.767819:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582839.767850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582839.767874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582839.767955:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162110848 00000100:00100000:2.0:1787582839.767976:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162110848 00000100:00100000:2.0:1787582839.768018:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 294 00000100:00100000:2.0:1787582839.768027:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162110848:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582839.768085:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162110848:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 58us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582839.768092:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 294 00000100:00100000:3.0:1787582839.768234:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162111232 00000100:00100000:3.0:1787582839.768239:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162111232 00000100:00100000:3.0:1787582839.768282:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 150 00000100:00100000:3.0:1787582839.768289:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83345526-3920-4b94-b598-4d9f74280322+6:2359:x1874416162111232:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582839.768355:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83345526-3920-4b94-b598-4d9f74280322+6:2359:x1874416162111232:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 66us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582839.768362:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 150 00000100:00080000:2.0:1787582839.770090:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582839.780611:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162110976 00000100:00100000:1.0:1787582839.780624:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162110976 00000100:00100000:1.0:1787582839.780697:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162111104 00000100:00100000:1.0:1787582839.780700:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162111104 00000100:00100000:1.0:1787582839.780725:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 83 00000100:00100000:1.0:1787582839.780734:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162110976:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582839.780800:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162110976:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 68us (13066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582839.780808:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 83 00000100:00100000:1.0:1787582839.780824:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 84 00000100:00100000:1.0:1787582839.780830:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2360:x1874416162111104:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582839.780850:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2360:x1874416162111104:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 21us (12975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582839.780865:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 84 00000100:00080000:0.0:1787582839.781028:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787582839.781032:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582839.898043:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186236928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787582839.898113:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582839.899850:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186236928 00000100:00100000:2.0:1787582839.899861:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186236928 00000100:00100000:2.0:1787582839.899925:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787582839.899934:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b62f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186236928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582839.899974:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582839.900032:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b62f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186236928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582839.900039:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1787582839.900300:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582839.900363:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483511880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186236928:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1787582839.953756:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787582839.953764:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787582839.953795:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787582839.953800:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787582840.272559:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582840.927821:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186237312:0@lo:400:kworker.0 00000100:00100000:0.0:1787582840.927879:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582840.927928:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582840.927943:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186237440:0@lo:400:kworker.0 00000100:00100000:0.0:1787582840.927965:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582840.928004:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186237440 00000100:00100000:0.0:1787582840.928009:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186237440 00000100:00100000:0.0:1787582840.928051:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787582840.928060:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186237440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582840.928295:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186237440:12345-0@lo:400:kworker.0 Request processed in 236us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582840.928303:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787582840.929275:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186237056:0@lo:400:kworker.0 00000100:00080000:0.0:1787582840.929569:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582840.929604:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186237440:0@lo:400:kworker.0 00000100:00100000:1.0:1787582840.929697:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582840.929728:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186237568:0@lo:400:kworker.0 00000100:00100000:1.0:1787582840.929753:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582840.929773:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787582840.929779:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186237184:0@lo:400:kworker.0 00000100:00100000:1.0:1787582840.929796:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582840.929811:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186237696:0@lo:400:kworker.0 00000100:00100000:1.0:1787582840.929828:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582840.929852:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186237312 00000100:00100000:1.0:1787582840.929857:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186237312 00000100:00100000:1.0:1787582840.929887:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186237696 00000100:00100000:1.0:1787582840.929889:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186237696 00000100:00100000:1.0:1787582840.929911:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787582840.929918:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186237312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582840.929953:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186237312:12345-0@lo:400:kworker.0 Request processed in 36us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582840.929959:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787582840.929971:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787582840.929976:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186237696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582840.929999:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186237696:12345-0@lo:400:kworker.0 Request processed in 23us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582840.930004:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787582840.930028:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186237056 00000100:00100000:1.0:1787582840.930039:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186237056 00000100:00100000:1.0:1787582840.930058:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787582840.930064:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186237056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582840.930827:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186237312:0@lo:400:kworker.0 00000100:00100000:1.0:1787582840.931291:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186237056:12345-0@lo:400:kworker.0 Request processed in 1225us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582840.931299:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787582840.931506:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186237568 00000100:00100000:1.0:1787582840.931512:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186237568 00000100:00100000:1.0:1787582840.931544:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186237184 00000100:00100000:1.0:1787582840.931547:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186237184 00000100:00100000:1.0:1787582840.931563:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787582840.931569:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186237568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582840.931601:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186237568:12345-0@lo:400:kworker.0 Request processed in 32us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582840.932706:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787582840.932732:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787582840.932741:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186237184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582840.932790:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186237184:12345-0@lo:400:kworker.0 Request processed in 51us (2992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582840.932796:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1787582840.932823:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787582840.932828:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787582840.932861:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186237184:0@lo:400:kworker.0 00000100:00100000:1.0:1787582840.932875:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186237696:0@lo:400:kworker.0 00000100:00100000:1.0:1787582840.932885:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186237056:0@lo:400:kworker.0 00000100:00100000:1.0:1787582840.932895:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186237568:0@lo:400:kworker.0 00000001:00080000:1.0:1787582840.998427:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:3.0:1787582841.297546:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582841.320091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582841.320239:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162111360 00000100:00100000:0.0:1787582841.320249:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162111360 00000100:00100000:0.0:1787582841.320349:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 139 00000100:00100000:0.0:1787582841.320374:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:11346:x1874416162111360:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582841.320393:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582841.320412:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753859e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d581a0 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320471:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320484:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320495:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320509:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75385ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320516:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75385ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320539:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75385ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320770:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320779:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320786:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320802:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582841.320806:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320814:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320827:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492100) 00010000:00010000:0.0:1787582841.320830:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582841.320833:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320838:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320848:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75385ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320853:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75385ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320858:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75385ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320862:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efa00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582841.320864:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75385ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320870:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75385ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320887:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8da5a0b68800) 00010000:00010000:0.0:1787582841.320890:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582841.320892:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75385ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320897:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75385ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320924:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753859e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581a0 expref: 14 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320934:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492100) 00010000:00010000:0.0:1787582841.320936:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582841.320940:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753859e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581a0 expref: 14 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.320950:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20efe00, rc 0) 00000100:00100000:0.0:1787582841.321008:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:11346:x1874416162111360:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 634us (923us total) trans 0 rc 301/301 00000100:00100000:0.0:1787582841.321015:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 139 00000100:00080000:1.0:1787582841.321476:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582841.334179:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582841.334502:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162111616 00000100:00100000:3.0:1787582841.334511:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162111616 00000100:00100000:3.0:1787582841.334580:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 140 00000100:00100000:3.0:1787582841.334590:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:11346:x1874416162111616:12345-192.168.206.20@tcp:36:lfs.0 00010000:00010000:3.0:1787582841.334653:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582841.334680:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9c000/0xa113d808b7537f1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fd9 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.334699:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492100) 00010000:00010000:3.0:1787582841.334704:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787582841.334977:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.334995:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538574 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58192 expref: 5 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.335003:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385b3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.335033:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538574 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58192 expref: 5 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.335048:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538574 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58192 expref: 5 pid: 5855 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582841.335062:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb5fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1874416186237824:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582841.335143:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58565c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582841.341121:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb5fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1874416186237824:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582841.341151:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582841.341846:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582841.344791:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162111744 00000100:00100000:3.0:1787582841.344803:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162111744 00010000:00010000:3.0:1787582841.344860:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538574 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58192 expref: 6 pid: 5855 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582841.344903:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 62 00000100:00100000:3.0:1787582841.344912:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83345526-3920-4b94-b598-4d9f74280322+6:2359:x1874416162111744:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582841.344926:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582841.344932:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538574 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58192 expref: 6 pid: 5855 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.344947:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538574 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58192 expref: 6 pid: 5855 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.344968:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538574 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58192 expref: 6 pid: 5855 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.344983:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492100) 00010000:00010000:3.0:1787582841.344988:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385b3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.344997:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.345005:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385b3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.345043:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582841.345094:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:83345526-3920-4b94-b598-4d9f74280322+5:2359:x1874416162111744:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 183us (3250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582841.345102:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 62 00010000:00010000:3.0:1787582841.345127:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.345135:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.345155:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75385ba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.345178:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75385ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.345186:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75385ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582841.346312:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787582841.346345:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385b3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.346353:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385b3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.346360:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.346366:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582841.346370:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385b3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.346385:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385b3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.346396:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492100) 00010000:00010000:3.0:1787582841.346398:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582841.346403:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385b3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.346409:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385b3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787582841.346425:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f62b108a reply state 0000000089f9e53d transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75385ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582841.346433:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787582841.346496:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:11346:x1874416162111616:12345-192.168.206.20@tcp:36:lfs.0 Request processed in 11906us (12332us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1787582841.346504:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 140 00000100:00080000:1.0:1787582841.347764:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787582841.354525:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75385ba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.354542:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75385ba lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.354549:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75385ba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.354568:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582841.354573:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75385ba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.354580:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75385ba lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.354595:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8da583acc200) 00010000:00010000:0.0:1787582841.354599:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582841.354615:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75385ba lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.354621:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75385ba lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582841.424499:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787582841.424521:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186237952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787582841.424603:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582841.424679:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186237952 00000100:00100000:0.0:1787582841.424687:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186237952 00000100:00100000:0.0:1787582841.424732:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787582841.424741:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186237952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787582841.424775:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582841.424817:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186237952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582841.424824:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787582841.424870:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186237952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582841.589403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582841.589512:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162111872 00000100:00100000:0.0:1787582841.589546:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162111872 00000100:00100000:0.0:1787582841.589591:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 141 00000100:00100000:0.0:1787582841.589599:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:11354:x1874416162111872:12345-192.168.206.20@tcp:101:lctl.0 00010000:00010000:0.0:1787582841.589628:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582841.589650:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75385c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d581a7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.589709:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.589721:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.589731:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582841.589787:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787582841.589791:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582841.589815:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.589837:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75385c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581a7 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.589852:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581a7 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.589860:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68800) 00010000:00010000:0.0:1787582841.589863:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787582841.589866:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ee000, rc 0) 00000100:00100000:0.0:1787582841.589925:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:11354:x1874416162111872:12345-192.168.206.20@tcp:101:lctl.0 Request processed in 326us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582841.589945:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 141 00000100:00100000:1.0:1787582841.700963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582841.701047:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162112000 00000100:00100000:3.0:1787582841.701057:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162112000 00000100:00100000:3.0:1787582841.701113:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 142 00000100:00100000:3.0:1787582841.701122:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:11360:x1874416162112000:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:3.0:1787582841.701151:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582841.701179:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d581ae expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701251:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75385d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701279:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75385d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701290:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75385d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701305:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75385dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701311:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75385dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701354:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75385dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701458:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b75385e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701466:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b75385e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701474:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b75385e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582841.701504:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787582841.701507:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787582841.701529:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b75385e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701540:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75385d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701555:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75385d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701562:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75385d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701568:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582841.701573:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75385d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701580:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75385d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701592:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68800) 00010000:00010000:3.0:1787582841.701595:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582841.701598:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75385d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701604:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b75385d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701617:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75385dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701623:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75385dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701629:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75385dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701634:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582841.701641:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75385dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701647:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75385dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701655:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8da583acce00) 00010000:00010000:3.0:1787582841.701657:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582841.701660:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75385dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701666:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75385dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701693:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75385cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581ae expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701705:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b75385e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581ae expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.701713:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:3.0:1787582841.701715:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787582841.701717:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1e00, rc 0) 00000100:00100000:3.0:1787582841.701779:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:11360:x1874416162112000:12345-192.168.206.20@tcp:101:bash.0 Request processed in 658us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582841.701786:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 142 00000100:00100000:3.0:1787582841.706280:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582841.706473:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162112256 00000100:00100000:0.0:1787582841.706483:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162112256 00000100:00100000:0.0:1787582841.706551:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 143 00000100:00100000:0.0:1787582841.706561:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+15:11360:x1874416162112256:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:0.0:1787582841.706578:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582841.706598:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75385eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d581b5 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.706722:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75385f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.706735:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75385f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.706744:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75385f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.706758:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75385f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.706764:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75385f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.706772:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75385f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787582841.707801:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1787582841.707963:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538600 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.707980:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.707989:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538600 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.708026:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75385f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.708033:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75385f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.708040:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75385f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.708045:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20eee00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582841.708050:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75385f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.708056:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75385f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.708069:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:0.0:1787582841.708072:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582841.708076:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75385f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.708083:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75385f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787582841.708095:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c911e100 reply state 00000000914f7a6a transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75385f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582841.708110:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787582841.708519:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75385eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581b5 expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.708776:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581b5 expref: 17 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582841.708785:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da5a0b68400) 00010000:00010000:0.0:1787582841.708787:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582841.708790:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20efe00, rc 0) 00000100:00100000:0.0:1787582841.708856:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:11360:x1874416162112256:12345-192.168.206.20@tcp:101:bash.0 Request processed in 2297us (2584us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1787582841.708864:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 143 00010000:00010000:3.0:1787582841.712198:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75385f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.712231:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75385f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.712239:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75385f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.712245:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582841.712250:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75385f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.712258:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75385f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.712275:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da5a0b68b00) 00010000:00010000:3.0:1787582841.712278:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582841.712283:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75385f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582841.712288:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75385f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582841.716299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582841.716822:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162112384 00000100:00100000:2.0:1787582841.716833:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162112384 00000100:00100000:2.0:1787582841.716906:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 48 00000100:00100000:2.0:1787582841.716916:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162112384:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:2.0:1787582841.716940:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582841.716961:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b753860e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d581bc expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787582841.716986:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787582841.717004:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1787582841.717009:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787582841.717018:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b753860e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581bc expref: 6 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582841.717053:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b753860e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581bc expref: 6 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582841.717066:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9f200, rc 0) 00000100:00080000:1.0:1787582841.717198:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787582841.717310:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162112384:12345-192.168.206.20@tcp:101:bash.0 Request processed in 394us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582841.717342:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 48 00000100:00100000:2.0:1787582841.726420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582841.727989:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162112512 00000100:00100000:1.0:1787582841.728003:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162112512 00000100:00100000:1.0:1787582841.728074:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 49 00000100:00100000:1.0:1787582841.728085:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:11360:x1874416162112512:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:1.0:1787582841.728102:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582841.728119:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d581c3 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582841.728167:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b753860e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581bc expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582841.728177:0:6703:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582841.728181:0:6703:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582841.728196:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582841.728234:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b753860e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581bc expref: 7 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582841.728268:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b753860e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581bc expref: 7 pid: 6705 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582841.728282:0:6703:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1874416186238080:192.168.206.20@tcp:104: 00000100:00100000:1.0:1787582841.728412:0:6703:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b5034e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787582841.732472:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582841.734207:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162112640 00000100:00100000:2.0:1787582841.734221:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162112640 00010000:00010000:2.0:1787582841.734276:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b753860e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581bc expref: 8 pid: 6705 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582841.734357:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 63 00000100:00100000:2.0:1787582841.734368:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2360:x1874416162112640:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582841.734381:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582841.734405:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b753860e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581bc expref: 8 pid: 6705 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582841.734421:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b753860e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581bc expref: 8 pid: 6705 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582841.734446:0:5838:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787582841.734451:0:5838:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787582841.734472:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 8 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582841.734482:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 8 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582841.734518:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 8 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582841.734532:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483512d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5838:1874416186238208:192.168.206.20@tcp:105: 00000100:00100000:2.0:1787582841.734613:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf328e40 going to sleep for 11 seconds 00010000:00010000:1.0:1787582841.735715:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050e9462e/0xa113d808b753860e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581bc expref: 8 pid: 6705 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582841.735734:0:6703:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e08700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1874416186238080:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582841.735759:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 7 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582841.735771:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7400, rc 0) 00000100:00100000:1.0:1787582841.735808:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483513100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:11360:x1874416162112512:12345-192.168.206.20@tcp:101:bash.0 Request processed in 7725us (9397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582841.735817:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 49 00000100:00100000:3.0:1787582841.739475:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582841.739633:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162112896 00000100:00100000:0.0:1787582841.739641:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162112896 00000100:00100000:0.0:1787582841.739695:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 36 00000100:00100000:0.0:1787582841.739706:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+17:11360:x1874416162112896:12345-192.168.206.20@tcp:35:bash.0 00000100:00100000:0.0:1787582841.740024:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:11360:x1874416162112896:12345-192.168.206.20@tcp:35:bash.0 Request processed in 320us (557us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787582841.740032:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 36 00000100:00100000:2.0:1787582841.740478:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483512d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5838:1874416186238208:192.168.206.20@tcp:105: 00010000:00010000:2.0:1787582841.740498:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582841.740540:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2360:x1874416162112640:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 6174us (8076us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582841.740549:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 63 00000100:00100000:3.0:1787582841.836937:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582841.837101:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162113152 00000100:00100000:2.0:1787582841.837111:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162113152 00000100:00100000:2.0:1787582841.837374:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 144 00000100:00100000:2.0:1787582841.837389:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:11370:x1874416162113152:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582841.837411:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582841.837430:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753861c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d581ca expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582841.837545:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787582841.837670:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753861c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581ca expref: 20 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582841.837695:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68800) 00010000:00010000:2.0:1787582841.837698:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787582841.837704:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753861c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581ca expref: 20 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582841.837717:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9e800, rc 0) 00000100:00100000:2.0:1787582841.837823:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:11370:x1874416162113152:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 437us (893us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787582841.852571:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 144 00000100:00100000:0.0:1787582841.852981:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582841.853052:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162113408 00000100:00100000:2.0:1787582841.853061:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162113408 00000100:00100000:2.0:1787582841.853158:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 37 00000100:00100000:2.0:1787582841.853169:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:11370:x1874416162113408:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:2.0:1787582841.853788:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+20:11370:x1874416162113408:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 619us (806us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1787582841.853796:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 37 00000040:00080000:3.0:1787582842.000521:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787582842.000530:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787582842.000773:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787582842.000780:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787582842.018466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582842.018680:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162113536 00000100:00100000:3.0:1787582842.018695:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162113536 00000100:00100000:3.0:1787582842.018794:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 145 00000100:00100000:3.0:1787582842.018807:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+20:11376:x1874416162113536:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:3.0:1787582842.018841:0:12083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582842.018883:0:12083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b753862a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d581d1 expref: -99 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.019145:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.019163:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.019180:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582842.019265:0:12083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787582842.019269:0:12083:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787582842.019294:0:12083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.019365:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b753862a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581d1 expref: 22 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.019388:0:12083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581d1 expref: 21 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.019398:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:3.0:1787582842.019402:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787582842.019406:0:12083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0200, rc 0) 00000100:00100000:3.0:1787582842.019479:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+21:11376:x1874416162113536:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 675us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582842.019746:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 145 00000100:00100000:3.0:1787582842.032070:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582842.034608:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162113792 00000100:00100000:0.0:1787582842.034628:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162113792 00000100:00100000:0.0:1787582842.034709:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 146 00000100:00100000:0.0:1787582842.034721:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+21:11376:x1874416162113792:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582842.034765:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582842.034791:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538638 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d581d8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582842.035196:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753863f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582842.035213:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753863f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582842.035225:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753863f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582842.035237:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787582842.035416:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581d8 expref: 24 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582842.035439:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753863f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581d8 expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582842.035449:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da5a0b68400) 00010000:00010000:0.0:1787582842.035452:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582842.035456:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20efa00, rc 0) 00000100:00100000:0.0:1787582842.035595:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+23:11376:x1874416162113792:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 876us (3538us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787582842.035605:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 146 00000100:00100000:0.0:1787582842.046167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582842.046222:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582842.046351:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162114176 00000100:00100000:2.0:1787582842.046363:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162114176 00000100:00100000:3.0:1787582842.046435:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162113920 00000100:00100000:2.0:1787582842.046447:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 147 00000100:00100000:3.0:1787582842.046451:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162113920 00000100:00100000:2.0:1787582842.046464:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+24:11376:x1874416162114176:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582842.046496:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582842.046530:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753864d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d581df expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582842.046552:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00100000:3.0:1787582842.046565:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+25:2357:x1874416162113920:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582842.046584:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582842.046608:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753863f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581d8 expref: 25 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.046631:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da5a0b68400) 00010000:00010000:3.0:1787582842.046635:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787582842.046657:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538654 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.046693:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538654 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582842.046705:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+24:2357:x1874416162113920:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 138us (477us total) trans 0 rc 0/0 00010000:00010000:2.0:1787582842.046709:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538654 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582842.046718:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 10 00000004:00200000:2.0:1787582842.046738:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787582842.046901:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b753864d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581df expref: 25 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.047053:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538654 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581df expref: 24 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.047063:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da5a0b68400) 00010000:00010000:2.0:1787582842.047066:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787582842.047069:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9e400, rc 0) 00000100:00100000:2.0:1787582842.047127:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+24:11376:x1874416162114176:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 669us (975us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787582842.047135:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 147 00000100:00100000:0.0:1787582842.064761:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582842.064872:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162114304 00000100:00100000:1.0:1787582842.064882:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162114304 00000100:00100000:1.0:1787582842.064947:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 50 00000100:00100000:1.0:1787582842.064958:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162114304:12345-192.168.206.20@tcp:1:lfs.0 00010000:00010000:1.0:1787582842.065011:0:8218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b7538662 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.065042:0:8218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.065050:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787582842.065055:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787582842.065060:0:8218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b7538662 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.065094:0:8218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 6 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.065109:0:8218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 6 pid: 6703 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582842.065124:0:8218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8218:1874416186238336:192.168.206.20@tcp:104: 00000100:00100000:1.0:1787582842.065239:0:8218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b5034e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787582842.068546:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582842.068664:0:8218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e0a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8218:1874416186238336:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582842.068688:0:8218:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b7538662 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582842.073561:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162114432 00000100:00100000:0.0:1787582842.073575:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162114432 00002000:00100000:0.0:1787582842.073631:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8da5bb5fc380 x1874416162114432/t0(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:308/0 lens 504/0 e 0 to 0 dl 1787582853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787582842.073642:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5bb5fc380 with x1874416162114432 ext(0->12) 00010000:00010000:0.0:1787582842.073651:0:6710:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 7 pid: 6703 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582842.073668:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 7 pid: 6703 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787582842.073677:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8da5bb5fc380 00000100:00100000:0.0:1787582842.073710:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 2 00000100:00100000:0.0:1787582842.073719:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2359:x1874416162114432:12345-192.168.206.20@tcp:4:lfs.0 00000100:00100000:0.0:1787582842.077795:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:2359:x1874416162114432:12345-192.168.206.20@tcp:4:lfs.0 Request processed in 4069us (9248us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787582842.077808:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 2 00002000:00100000:0.0:1787582842.077819:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8da5bb5fc380 x1874416162114432/t4294967305(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:308/0 lens 504/448 e 0 to 0 dl 1787582853 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787582842.077829:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5bb5fc380 with x1874416162114432 ext(0->12) 00010000:00010000:0.0:1787582842.077839:0:6710:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 9 pid: 6703 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582842.077857:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 9 pid: 6703 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787582842.077877:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8da5bb5fc380 00000100:00100000:2.0:1787582842.082262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582842.082496:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162114560 00000100:00100000:3.0:1787582842.082506:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162114560 00010000:00010000:3.0:1787582842.082542:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 9 pid: 6703 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582842.082584:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 64 00000100:00100000:3.0:1787582842.082594:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:2358:x1874416162114560:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582842.082608:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787582842.082627:0:5840:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787582842.082630:0:5840:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787582842 00002000:00010000:3.0:1787582842.082643:0:5840:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787582842 00002000:00010000:3.0:1787582842.082645:0:5840:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787582842 00010000:00010000:3.0:1787582842.082652:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 9 pid: 6703 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.082666:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 9 pid: 6703 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.082691:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd60c37e/0xa113d808b7538615 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581c3 expref: 9 pid: 6703 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.082707:0:5840:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787582842.082711:0:5840:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787582842.082716:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b7538662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.082725:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b7538662 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.084418:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582842.084490:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483512d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2358:x1874416162114560:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 1892us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582842.084500:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 64 00010000:00010000:1.0:1787582842.091865:0:8218:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b7538662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.091885:0:8218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b7538662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.091940:0:8218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b7538662 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.091950:0:8218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b7538662 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.091958:0:8218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b7538662 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.091965:0:8218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6c00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:1.0:1787582842.091970:0:8218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b7538662 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.092234:0:8218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b7538662 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.092254:0:8218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b7538662 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.092263:0:8218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094bc8a3d/0xa113d808b7538662 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582842.093569:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2359:x1874416162114304:12345-192.168.206.20@tcp:1:lfs.0 Request processed in 28603us (28807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582842.093581:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 50 00000100:00100000:2.0:1787582842.099485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582842.099577:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162114816 00000100:00100000:1.0:1787582842.099586:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162114816 00000100:00100000:1.0:1787582842.099652:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 38 00000100:00100000:1.0:1787582842.099662:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583665450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+24:11376:x1874416162114816:12345-192.168.206.20@tcp:35:lfs.0 00000004:00010000:1.0:1787582842.099718:0:5857:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538654 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581df expref: 24 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787582842.099949:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1787582842.099993:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787582842.100883:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787582842.100939:0:5857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538669 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.100955:0:5857:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538600 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581b5 expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.100964:0:5857:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538669 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.100998:0:5857:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581b5 expref: 28 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.101013:0:5857:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538600 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581b5 expref: 28 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582842.101027:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e0a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5857:1874416186238464:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582842.102017:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b5034e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582842.104851:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e0a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5857:1874416186238464:192.168.206.20@tcp:104: 00010000:00010000:2.0:1787582842.104877:0:5857:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538669 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582842.105883:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582842.106096:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162114944 00000100:00100000:3.0:1787582842.106105:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162114944 00010000:00010000:3.0:1787582842.106138:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538600 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581b5 expref: 29 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582842.106211:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 65 00000100:00100000:3.0:1787582842.106221:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5911aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+29:2360:x1874416162114944:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582842.106235:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582842.106242:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538600 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581b5 expref: 29 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.106255:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538600 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581b5 expref: 29 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.106275:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538600 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581b5 expref: 29 pid: 5854 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.106291:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da5a0b68400) 00010000:00010000:3.0:1787582842.106296:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538669 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.106306:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538669 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.106313:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538669 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.106370:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582842.106415:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5911aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+28:2360:x1874416162114944:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 195us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582842.106422:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 65 00010000:00010000:2.0:1787582842.106910:0:5857:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538669 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.106926:0:5857:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538669 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787582842.107042:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787582842.107253:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787582842.107383:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483511f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1874416186238592:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787582842.107428:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582842.107457:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf328300 going to sleep for 11 seconds 00000100:00100000:3.0:1787582842.107626:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186238592 00000100:00100000:3.0:1787582842.107638:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186238592 00000100:00100000:3.0:1787582842.107694:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787582842.107701:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874416186238592:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787582842.107760:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483513480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874416186238592:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 60us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582842.107767:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1787582842.107988:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787582842.108018:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483511f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1874416186238592:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787582842.108599:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787582842.109287:0:5857:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da483511f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1874416186238720:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787582842.109758:0:5857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582842.109824:0:5857:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf328480 going to sleep for 11 seconds 00000100:00100000:3.0:1787582842.120800:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186238720 00000100:00100000:3.0:1787582842.120815:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186238720 00000100:00100000:3.0:1787582842.120943:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787582842.120954:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5857:x1874416186238720:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787582842.121249:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483513800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5857:x1874416186238720:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 297us (11491us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787582842.121258:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787582842.127967:0:5857:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da483511f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5857:1874416186238720:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787582842.128065:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1787582842.128125:0:5857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538669 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.128136:0:5857:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538669 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.128143:0:5857:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538669 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.128149:0:5857:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582842.128154:0:5857:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538669 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.128255:0:5857:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538669 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.128271:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da5a0b68400) 00010000:00010000:2.0:1787582842.128273:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787582842.128278:0:5857:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538669 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.128284:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538669 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5857 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787582842.128576:0:5857:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787582842.132332:0:5857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1787582842.132350:0:5857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383139031599ns, next at 384139028025ns, rc = 0 00000001:00080000:2.0:1787582842.132363:0:5857:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787582842.132432:0:5857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da5a0b68400) 00010000:00010000:2.0:1787582842.132437:0:5857:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787582842.132448:0:5857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538654 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581df expref: 32 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582842.132774:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583665450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+31:11376:x1874416162114816:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 33111us (33296us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1787582842.132784:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 38 00000020:00080000:2.0:1787582842.132790:0:5857:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787582842.144004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582842.144079:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162115072 00000100:00100000:3.0:1787582842.144089:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162115072 00000100:00100000:3.0:1787582842.144154:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 148 00000100:00100000:3.0:1787582842.144174:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+31:11376:x1874416162115072:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:3.0:1787582842.144206:0:12083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582842.144228:0:12083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538670 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d581e6 expref: -99 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.144283:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538670 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581e6 expref: 32 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.144297:0:12083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538670 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581e6 expref: 32 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.144371:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:3.0:1787582842.144374:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787582842.144378:0:12083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1400, rc 0) 00000100:00100000:3.0:1787582842.144431:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483512d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+32:11376:x1874416162115072:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 259us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582842.144437:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 148 00000100:00100000:0.0:1787582842.154929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582842.154996:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162115328 00000100:00100000:2.0:1787582842.155005:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162115328 00000100:00100000:2.0:1787582842.155059:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 39 00000100:00100000:2.0:1787582842.155069:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+32:11376:x1874416162115328:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:2.0:1787582842.155503:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+33:11376:x1874416162115328:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 435us (581us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787582842.155510:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 39 00000100:00100000:0.0:1787582842.287476:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582842.287559:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162115584 00000100:00100000:3.0:1787582842.287569:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162115584 00000100:00100000:3.0:1787582842.287626:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 149 00000100:00100000:3.0:1787582842.287636:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+33:11386:x1874416162115584:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:3.0:1787582842.287658:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582842.287677:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b7538677 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d581ed expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582842.287784:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787582842.287894:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b7538677 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581ed expref: 35 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.287908:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68800) 00010000:00010000:3.0:1787582842.287911:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787582842.287916:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b7538677 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581ed expref: 35 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582842.287929:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0c00, rc 0) 00000100:00100000:3.0:1787582842.287997:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+34:11386:x1874416162115584:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 362us (528us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1787582842.288018:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 149 00000100:00100000:3.0:1787582842.296707:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582842.298080:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162115712 00000100:00100000:0.0:1787582842.298094:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162115712 00000100:00100000:0.0:1787582842.298157:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 150 00000100:00100000:0.0:1787582842.298167:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+34:11386:x1874416162115712:12345-192.168.206.20@tcp:34:lfs.0 00010000:00010000:0.0:1787582842.298246:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538685 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582842.298263:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538685 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582842.298275:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538685 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582842.298290:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753868c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582842.298300:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753868c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582842.298306:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753868c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.298958:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538693 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.298995:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299004:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787582842.299047:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299059:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538685 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299066:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538685 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299072:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299078:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20eee00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582842.299082:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299089:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538685 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299101:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:1.0:1787582842.299104:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582842.299109:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538685 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299115:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538685 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299137:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753868c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299142:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753868c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299148:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753868c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299152:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efe00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582842.299167:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753868c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299174:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753868c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299190:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da5a0b68100) 00010000:00010000:1.0:1787582842.299193:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582842.299196:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753868c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299201:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753868c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299217:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299223:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538693 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299230:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299241:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582842.299245:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299252:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538693 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299261:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:1.0:1787582842.299263:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582842.299266:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538693 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.299273:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538693 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582842.299388:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+34:11386:x1874416162115712:12345-192.168.206.20@tcp:34:lfs.0 Request processed in 1220us (2686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582842.299396:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 150 00000100:00100000:0.0:1787582842.304429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582842.304718:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162115968 00000100:00100000:2.0:1787582842.304727:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162115968 00000100:00100000:2.0:1787582842.304783:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 40 00000100:00100000:2.0:1787582842.304794:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+34:11386:x1874416162115968:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:2.0:1787582842.305084:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+35:11386:x1874416162115968:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 291us (663us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787582842.305092:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 40 00010000:00010000:3.0:1787582842.320562:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582842.406435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582842.406538:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162116224 00000100:00100000:1.0:1787582842.406548:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162116224 00000100:00100000:1.0:1787582842.406609:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 151 00000100:00100000:1.0:1787582842.406619:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+35:11389:x1874416162116224:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:1.0:1787582842.406642:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582842.406660:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b753869a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d581f4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.406732:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.406754:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.406765:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.406779:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75386a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.406786:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75386a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.406792:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75386a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.406910:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75386af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.406917:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75386af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.406924:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75386af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582842.406933:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787582842.407022:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407029:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407035:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407048:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582842.407052:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407059:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407086:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:1.0:1787582842.407089:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582842.407093:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407099:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407112:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75386a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407117:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75386a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407123:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75386a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407127:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582842.407130:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75386a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407136:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75386a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407152:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da58533f700) 00010000:00010000:1.0:1787582842.407154:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582842.407157:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75386a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407162:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75386a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407213:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b753869a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581f4 expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407227:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75386af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581f4 expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582842.407234:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:1.0:1787582842.407236:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582842.407238:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6a00, rc 0) 00000100:00100000:1.0:1787582842.407297:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+37:11389:x1874416162116224:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 679us (870us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787582842.407304:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 151 00000100:00100000:3.0:1787582842.412528:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582842.413124:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162116352 00000100:00100000:2.0:1787582842.413134:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162116352 00000100:00100000:2.0:1787582842.413237:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 152 00000100:00100000:2.0:1787582842.413248:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+37:11389:x1874416162116352:12345-192.168.206.20@tcp:54:lfs.0 00010000:00010000:2.0:1787582842.413341:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b75386bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.413369:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b75386bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.413380:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b75386bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.413406:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b75386bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.413412:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b75386bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.413448:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b75386bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.413453:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9e400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582842.413457:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b75386bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.413465:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b75386bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.413477:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:2.0:1787582842.413480:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787582842.413484:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b75386bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582842.413490:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b75386bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582842.413563:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+37:11389:x1874416162116352:12345-192.168.206.20@tcp:54:lfs.0 Request processed in 317us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582842.413570:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 152 00000100:00100000:0.0:1787582842.425305:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582842.425570:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162116608 00000100:00100000:3.0:1787582842.425579:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162116608 00000100:00100000:3.0:1787582842.425633:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 41 00000100:00100000:3.0:1787582842.425643:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+37:11389:x1874416162116608:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:3.0:1787582842.425942:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+38:11389:x1874416162116608:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 300us (645us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787582842.425950:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 41 00000100:00100000:0.0:1787582843.107859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582843.107947:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162116864 00000100:00100000:1.0:1787582843.107957:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162116864 00000100:00100000:1.0:1787582843.108037:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 153 00000100:00100000:1.0:1787582843.108049:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+38:11420:x1874416162116864:12345-192.168.206.20@tcp:101:cat.0 00010000:00010000:1.0:1787582843.108071:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582843.108091:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b75386c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d581fb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.108220:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75386cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.108234:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75386cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.108245:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75386cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582843.108256:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787582843.108418:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b75386c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581fb expref: 41 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.108436:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75386cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581fb expref: 40 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.108445:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:1.0:1787582843.108447:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582843.108450:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7c00, rc 0) 00000100:00100000:1.0:1787582843.108506:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+40:11420:x1874416162116864:12345-192.168.206.20@tcp:101:cat.0 Request processed in 460us (656us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787582843.108513:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 153 00000100:00080000:2.0:1787582843.109160:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582843.119429:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582843.119523:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162116992 00000100:00100000:2.0:1787582843.119533:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162116992 00000100:00100000:2.0:1787582843.119595:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00100000:2.0:1787582843.119605:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+40:2358:x1874416162116992:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582843.119620:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582843.119647:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b75386cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581fb expref: 40 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582843.119680:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:2.0:1787582843.119685:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582843.119739:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+39:2358:x1874416162116992:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 135us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582843.119747:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00100000:0.0:1787582843.126216:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582843.126287:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162117248 00000100:00100000:2.0:1787582843.126297:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162117248 00000100:00100000:2.0:1787582843.126375:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 42 00000100:00100000:2.0:1787582843.126385:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+39:11420:x1874416162117248:12345-192.168.206.20@tcp:35:cat.0 00000100:00100000:2.0:1787582843.126610:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+40:11420:x1874416162117248:12345-192.168.206.20@tcp:35:cat.0 Request processed in 225us (400us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787582843.126617:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 42 00000100:00100000:0.0:1787582843.242067:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582843.242162:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162117504 00000100:00100000:1.0:1787582843.242172:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162117504 00000100:00100000:1.0:1787582843.242238:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 154 00000100:00100000:1.0:1787582843.242248:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+40:11426:x1874416162117504:12345-192.168.206.20@tcp:101:dd.0 00010000:00010000:1.0:1787582843.242269:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582843.242284:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787582843.242310:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538631 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581d1 expref: 40 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.242360:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:1.0:1787582843.242365:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787582843.242377:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b75386d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58202 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.242471:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.242484:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75386af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581f4 expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.242492:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.242534:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75386af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581f4 expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.242548:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75386af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581f4 expref: 40 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582843.242560:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186238848:192.168.206.20@tcp:104: 00000100:00100000:1.0:1787582843.242649:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b50343c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582843.246357:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582843.246637:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186238848:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582843.246661:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582843.246787:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162117632 00000100:00100000:3.0:1787582843.246794:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162117632 00010000:00010000:3.0:1787582843.246825:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75386af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581f4 expref: 41 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582843.246860:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 66 00000100:00100000:3.0:1787582843.246869:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+41:2359:x1874416162117632:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582843.246881:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582843.246888:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75386af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581f4 expref: 41 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.246899:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75386af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581f4 expref: 41 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.246919:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75386af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581f4 expref: 41 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.246949:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:3.0:1787582843.246954:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.246962:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.246969:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.246993:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582843.247044:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+40:2359:x1874416162117632:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 175us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582843.247050:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 66 00010000:00010000:1.0:1787582843.247156:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.247163:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582843.247189:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787582843.247358:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b75386d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58202 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.247373:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58202 expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.247380:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:1.0:1787582843.247383:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787582843.247386:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6e00, rc 0) 00000100:00100000:1.0:1787582843.247425:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+40:11426:x1874416162117504:12345-192.168.206.20@tcp:101:dd.0 Request processed in 5178us (5365us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787582843.247447:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 154 00000100:00100000:0.0:1787582843.252917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582843.253003:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162117888 00000100:00100000:2.0:1787582843.253012:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162117888 00000100:00100000:2.0:1787582843.253066:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 155 00000100:00100000:2.0:1787582843.253075:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+40:11426:x1874416162117888:12345-192.168.206.20@tcp:36:dd.0 00010000:00010000:2.0:1787582843.253370:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75386ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582843.253386:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75386ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582843.253397:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75386ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787582843.253446:0:7653:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787582843.253483:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000d8c0536 reply state 000000003209511e transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75386ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582843.253492:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787582843.253572:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+43:11426:x1874416162117888:12345-192.168.206.20@tcp:36:dd.0 Request processed in 497us (664us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787582843.253580:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 155 00000020:00080000:2.0:1787582843.253584:0:7653:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787582843.256104:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75386ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582843.256120:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75386ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582843.256127:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75386ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582843.256147:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9f000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582843.256152:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75386ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582843.256160:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75386ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582843.256175:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:0.0:1787582843.256186:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582843.256191:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75386ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582843.256198:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75386ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.347616:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582843.854969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582843.855267:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162118016 00000100:00100000:3.0:1787582843.855276:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162118016 00000100:00100000:3.0:1787582843.855751:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 156 00000100:00100000:3.0:1787582843.855763:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+42:11440:x1874416162118016:12345-192.168.206.20@tcp:101:stat.0 00010000:00010000:3.0:1787582843.855785:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582843.855804:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75386f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58209 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.855864:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b75386fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.855877:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b75386fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.855905:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b75386fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.855921:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538703 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.855928:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.855934:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.856106:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753870a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.856119:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58202 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.856128:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753870a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.856161:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58202 expref: 43 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.856187:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58202 expref: 43 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582843.856201:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb5ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1874416186238976:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582843.856296:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58565c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787582843.864098:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb5ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5854:1874416186238976:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582843.864139:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753870a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582843.866807:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582843.869001:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162118272 00000100:00100000:3.0:1787582843.869022:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162118272 00000100:00100000:3.0:1787582843.869188:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 43 00000100:00100000:3.0:1787582843.869201:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+44:5597:x1874416162118272:12345-192.168.206.20@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787582843.873118:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+45:5597:x1874416162118272:12345-192.168.206.20@tcp:35:ldlm_bl.0 Request processed in 3903us (6308us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787582843.873136:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 43 00000100:00100000:2.0:1787582843.886118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582843.890009:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162118400 00000100:00100000:0.0:1787582843.890043:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162118400 00010000:00010000:0.0:1787582843.890127:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58202 expref: 45 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582843.890260:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 67 00000100:00100000:0.0:1787582843.890274:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483511880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+45:2360:x1874416162118400:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787582843.890297:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582843.890305:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58202 expref: 45 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582843.890372:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58202 expref: 45 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582843.890403:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b75386e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58202 expref: 45 pid: 5852 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582843.890430:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:0.0:1787582843.890436:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753870a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582843.890447:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753870a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582843.890456:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753870a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582843.890493:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582843.890579:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483511880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+44:2360:x1874416162118400:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 308us (4474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582843.890605:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 67 00010000:00010000:1.0:1787582843.890696:0:5854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753870a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.894297:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753870a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582843.894425:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787582843.894433:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582843.894501:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753870a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.894557:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753870a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.894574:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b75386fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.894582:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b75386fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.894591:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b75386fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.894598:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582843.894604:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b75386fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.894623:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b75386fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.894644:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:1.0:1787582843.894648:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582843.894653:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b75386fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.894660:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b75386fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.894684:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.894690:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538703 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.895079:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.895084:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582843.895088:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.895094:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538703 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.895104:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da583acc500) 00010000:00010000:1.0:1787582843.895107:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582843.895111:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538703 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.895116:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b7538703 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.895187:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b75386f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58209 expref: 44 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.895205:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753870a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58209 expref: 43 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.895213:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:1.0:1787582843.895215:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582843.895217:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1600, rc 0) 00000100:00100000:1.0:1787582843.895369:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+43:11440:x1874416162118016:12345-192.168.206.20@tcp:101:stat.0 Request processed in 39606us (40406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582843.895396:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 156 00000100:00100000:2.0:1787582843.956040:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582843.956371:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162118656 00000100:00100000:1.0:1787582843.956385:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162118656 00000100:00100000:1.0:1787582843.956459:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 157 00000100:00100000:1.0:1787582843.956471:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+43:11446:x1874416162118656:12345-192.168.206.20@tcp:36:truncate.0 00010000:00010000:1.0:1787582843.956553:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582843.956587:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b753870a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58209 expref: 43 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.956613:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:1.0:1787582843.956618:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787582843.956893:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538711 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.956909:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582843.956919:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787582843.956974:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787582843.956998:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000aea0708 reply state 00000000f90c6636 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582843.957019:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787582843.957131:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+45:11446:x1874416162118656:12345-192.168.206.20@tcp:36:truncate.0 Request processed in 661us (1105us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787582843.957138:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 157 00000020:00080000:1.0:1787582843.957638:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787582843.964887:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.964910:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538711 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.964918:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538711 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.964925:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582843.964930:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538711 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.964939:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538711 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.964960:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:3.0:1787582843.964964:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582843.964987:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538711 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582843.964994:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538711 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787582844.036265:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1787582844.036654:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:2.0:1787582844.119057:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582844.119248:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162118784 00000100:00100000:1.0:1787582844.119261:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162118784 00000100:00100000:1.0:1787582844.119476:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 158 00000100:00100000:1.0:1787582844.119489:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+44:11460:x1874416162118784:12345-192.168.206.20@tcp:101:stat.0 00010000:00010000:1.0:1787582844.119525:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582844.119551:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538718 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58210 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.119635:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b753871f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.119651:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b753871f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.119666:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b753871f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.119682:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538726 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.119689:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.119694:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.119809:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753872d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.119827:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753872d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.119854:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753872d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582844.119917:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1787582844.119922:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582844.119945:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753872d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.119958:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753872d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.119967:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b753871f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.119973:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b753871f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.119980:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b753871f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.119987:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582844.119992:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b753871f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.119999:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b753871f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.120011:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:1.0:1787582844.120015:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582844.120020:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b753871f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.120036:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b753871f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.120052:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.120058:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538726 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.120064:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.120070:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582844.120073:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.120080:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538726 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.120088:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da58533f700) 00010000:00010000:1.0:1787582844.120090:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582844.120093:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538726 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.120099:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538726 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.120137:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538718 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58210 expref: 46 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.120164:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753872d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58210 expref: 45 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.120186:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:1.0:1787582844.120188:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582844.120191:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7c00, rc 0) 00000100:00100000:1.0:1787582844.120260:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+45:11460:x1874416162118784:12345-192.168.206.20@tcp:101:stat.0 Request processed in 773us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582844.120267:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 158 00000100:00100000:0.0:1787582844.211908:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582844.214564:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162119040 00000100:00100000:1.0:1787582844.214584:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162119040 00000100:00100000:1.0:1787582844.214676:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 159 00000100:00100000:1.0:1787582844.214690:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+45:11470:x1874416162119040:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:1.0:1787582844.214716:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582844.214742:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538734 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58217 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582844.214884:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787582844.215046:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538734 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58217 expref: 47 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.215064:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68800) 00010000:00010000:1.0:1787582844.215067:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787582844.215073:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538734 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58217 expref: 47 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.215091:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6600, rc 0) 00000100:00100000:1.0:1787582844.215199:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+46:11470:x1874416162119040:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 511us (3302us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1787582844.215421:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 159 00000100:00100000:0.0:1787582844.221454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582844.221636:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162119296 00000100:00100000:3.0:1787582844.221648:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162119296 00000100:00100000:3.0:1787582844.221713:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 44 00000100:00100000:3.0:1787582844.221723:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583666850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+46:11470:x1874416162119296:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:3.0:1787582844.222025:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583666850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+47:11470:x1874416162119296:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 303us (584us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787582844.222034:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 44 00000100:00100000:0.0:1787582844.351155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582844.351261:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162119552 00000100:00100000:1.0:1787582844.351275:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162119552 00000100:00100000:1.0:1787582844.351412:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 160 00000100:00100000:1.0:1787582844.351426:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+47:11476:x1874416162119552:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:1.0:1787582844.351458:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582844.351483:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538742 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5821e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.351623:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.351640:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753872d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58210 expref: 48 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.351650:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.351695:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753872d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58210 expref: 48 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.351712:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753872d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58210 expref: 48 pid: 5855 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582844.351727:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8e0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186239104:192.168.206.20@tcp:104: 00000100:00100000:1.0:1787582844.351826:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b50349c0 going to sleep for 11 seconds 00010000:00010000:3.0:1787582844.368597:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582844.375105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582844.375632:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162119680 00000100:00100000:3.0:1787582844.375644:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162119680 00010000:00010000:3.0:1787582844.375696:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753872d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58210 expref: 49 pid: 5855 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582844.375744:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 68 00000100:00100000:3.0:1787582844.375756:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+49:2359:x1874416162119680:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582844.375774:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582844.375781:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753872d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58210 expref: 49 pid: 5855 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.375796:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753872d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58210 expref: 49 pid: 5855 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.375839:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:3.0:1787582844.375844:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.375854:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.375862:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.375895:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582844.375964:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+49:2359:x1874416162119680:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 211us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582844.375972:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 68 00010000:00010000:1.0:1787582844.376672:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753872d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58210 expref: 48 pid: 5855 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582844.376701:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8e0b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186239104:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582844.376730:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.376744:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.376751:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582844.376774:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1787582844.376968:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538742 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5821e expref: 49 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.376984:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5821e expref: 48 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.376994:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:1.0:1787582844.376997:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787582844.377000:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6a00, rc 0) 00000100:00100000:1.0:1787582844.377039:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+48:11476:x1874416162119552:12345-192.168.206.20@tcp:101:bash.0 Request processed in 25616us (25905us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1787582844.377047:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 160 00000100:00100000:0.0:1787582844.384745:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582844.384839:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162119936 00000100:00100000:1.0:1787582844.384853:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162119936 00000100:00100000:1.0:1787582844.384938:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 161 00000100:00100000:1.0:1787582844.384951:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+48:11476:x1874416162119936:12345-192.168.206.20@tcp:36:bash.0 00010000:00010000:1.0:1787582844.385985:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538757 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.386007:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538757 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.386020:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538757 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787582844.386076:0:5855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787582844.386773:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023d95170 reply state 000000004061d021 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538757 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582844.386786:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787582844.386928:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+51:11476:x1874416162119936:12345-192.168.206.20@tcp:36:bash.0 Request processed in 1975us (2194us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787582844.386936:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 161 00000020:00080000:2.0:1787582844.386942:0:5855:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787582844.395770:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582844.396184:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162120064 00000100:00100000:3.0:1787582844.396198:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162120064 00000100:00100000:3.0:1787582844.396282:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 162 00000100:00100000:3.0:1787582844.396294:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+51:11476:x1874416162120064:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:3.0:1787582844.396358:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582844.396385:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b753875e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58225 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582844.399671:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538757 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582844.399691:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538757 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582844.399701:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538757 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582844.399708:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582844.399713:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538757 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582844.399721:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538757 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582844.399741:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:0.0:1787582844.399744:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582844.399748:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538757 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582844.399754:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538757 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.402998:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538765 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.403036:0:7653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5821e expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.403047:0:7653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538765 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.403097:0:7653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5821e expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.403530:0:7653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5821e expref: 51 pid: 5852 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582844.403678:0:7653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1874416186239232:192.168.206.20@tcp:104: 00000100:00100000:2.0:1787582844.403851:0:7653:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf328840 going to sleep for 11 seconds 00000100:00100000:2.0:1787582844.413057:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582844.413255:0:7653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1874416186239232:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582844.413307:0:7653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538765 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582844.413657:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162120192 00000100:00100000:3.0:1787582844.413667:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162120192 00010000:00010000:3.0:1787582844.413711:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5821e expref: 52 pid: 5852 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582844.413753:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 69 00000100:00100000:3.0:1787582844.413772:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+52:2359:x1874416162120192:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582844.413788:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582844.413795:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5821e expref: 52 pid: 5852 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.413810:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5821e expref: 52 pid: 5852 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.413835:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538749 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5821e expref: 52 pid: 5852 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.413853:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:3.0:1787582844.413859:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538765 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.413933:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.413941:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538765 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.413974:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582844.414042:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+51:2359:x1874416162120192:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 272us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582844.414050:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 69 00010000:00010000:2.0:1787582844.414814:0:7653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.414825:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582844.415142:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787582844.415148:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787582844.415766:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.415817:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b753875e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58225 expref: 51 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.415837:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538765 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58225 expref: 50 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.415845:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:2.0:1787582844.415848:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787582844.415852:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9e600, rc 0) 00000100:00100000:2.0:1787582844.418616:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+50:11476:x1874416162120064:12345-192.168.206.20@tcp:101:bash.0 Request processed in 22308us (22841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582844.418647:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 162 00000100:00100000:2.0:1787582844.436002:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582844.436257:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162120448 00000100:00100000:3.0:1787582844.436271:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162120448 00000100:00100000:2.0:1787582844.436451:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 45 00000100:00100000:2.0:1787582844.436466:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+50:11476:x1874416162120448:12345-192.168.206.20@tcp:35:bash.0 00000100:00100000:2.0:1787582844.436766:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+51:11476:x1874416162120448:12345-192.168.206.20@tcp:35:bash.0 Request processed in 304us (777us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787582844.436775:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 45 00000100:00100000:1.0:1787582844.536058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582844.536767:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162120704 00000100:00100000:2.0:1787582844.536780:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162120704 00000100:00100000:2.0:1787582844.537060:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 163 00000100:00100000:2.0:1787582844.537073:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+51:11486:x1874416162120704:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582844.537104:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582844.537129:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753876c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5822c expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582844.537740:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787582844.537894:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753876c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5822c expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.537913:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68800) 00010000:00010000:2.0:1787582844.537917:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787582844.537923:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753876c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5822c expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.537941:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9f800, rc 0) 00000100:00100000:2.0:1787582844.538231:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+52:11486:x1874416162120704:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 1159us (2184us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787582844.538239:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 163 00000100:00100000:1.0:1787582844.543723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582844.543911:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162120832 00000100:00100000:2.0:1787582844.543925:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162120832 00000100:00100000:2.0:1787582844.544060:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 164 00000100:00100000:2.0:1787582844.544074:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+52:11486:x1874416162120832:12345-192.168.206.20@tcp:34:lfs.0 00010000:00010000:2.0:1787582844.544168:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753877a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544201:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753877a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544215:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753877a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544233:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538781 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544241:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544312:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544488:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b7538788 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544497:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b7538788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544504:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b7538788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787582844.544574:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b7538788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544590:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753877a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544597:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753877a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544604:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753877a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544610:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9f800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582844.544615:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753877a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544623:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753877a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544636:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:2.0:1787582844.544639:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582844.544644:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753877a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544650:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753877a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544665:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544670:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538781 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544682:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538781 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544687:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9fe00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582844.544690:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538781 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544696:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538781 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544704:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da5a4492a00) 00010000:00010000:2.0:1787582844.544707:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582844.544709:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538781 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544715:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538781 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544730:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b7538788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544736:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b7538788 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544742:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b7538788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544747:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9ea00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582844.544749:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b7538788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544765:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b7538788 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544774:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:2.0:1787582844.544776:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582844.544779:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b7538788 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.544785:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b7538788 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582844.544887:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+52:11486:x1874416162120832:12345-192.168.206.20@tcp:34:lfs.0 Request processed in 815us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582844.544896:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 164 00000100:00100000:0.0:1787582844.547484:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582844.547606:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162121088 00000100:00100000:2.0:1787582844.547618:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162121088 00000100:00100000:2.0:1787582844.547685:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 46 00000100:00100000:2.0:1787582844.547696:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+52:11486:x1874416162121088:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:2.0:1787582844.548106:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+53:11486:x1874416162121088:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 410us (635us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787582844.548115:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 46 00000100:00100000:3.0:1787582844.605137:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582844.606122:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162121344 00000100:00100000:2.0:1787582844.606138:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162121344 00000100:00100000:2.0:1787582844.606238:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 165 00000100:00100000:2.0:1787582844.606251:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb5ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+53:11489:x1874416162121344:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582844.606290:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582844.606591:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b753878f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58233 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.606715:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538796 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.606731:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538796 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.606744:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538796 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.606761:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753879d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.606767:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753879d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.606773:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753879d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.606937:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b75387a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.606945:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b75387a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.606951:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b75387a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582844.606961:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787582844.608731:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538796 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.608748:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538796 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.608771:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538796 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.608778:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9fe00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582844.608783:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538796 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.608792:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538796 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.608810:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:2.0:1787582844.608814:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582844.608819:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538796 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.608827:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538796 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.608847:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753879d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.608853:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753879d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.608858:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753879d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.610406:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9f800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582844.610425:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753879d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.610457:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753879d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.610474:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da5a4492a00) 00010000:00010000:2.0:1787582844.610477:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582844.610483:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753879d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.610489:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f800/0xa113d808b753879d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.610578:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b753878f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58233 expref: 56 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.610595:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b75387a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58233 expref: 55 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.610603:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:2.0:1787582844.610605:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787582844.610608:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9e000, rc 0) 00000100:00100000:2.0:1787582844.610695:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb5ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:11489:x1874416162121344:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 4446us (5572us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787582844.610705:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 165 00000100:00100000:3.0:1787582844.665854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582844.666265:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582844.666831:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162121600 00000100:00100000:1.0:1787582844.666845:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162121600 00000100:00100000:1.0:1787582844.666926:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 166 00000100:00100000:1.0:1787582844.666938:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:11489:x1874416162121600:12345-192.168.206.20@tcp:54:lfs.0 00010000:00010000:1.0:1787582844.667098:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75387b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.667119:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75387b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.667133:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75387b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.667168:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75387b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.667214:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75387b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.667542:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75387b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.667548:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582844.667553:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75387b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.667560:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75387b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.667574:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:1.0:1787582844.667577:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787582844.667581:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75387b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.667588:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b75387b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582844.667672:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:11489:x1874416162121600:12345-192.168.206.20@tcp:54:lfs.0 Request processed in 735us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582844.667681:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 166 00000100:00100000:2.0:1787582844.668223:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162121472 00000100:00100000:2.0:1787582844.668241:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162121472 00000100:00100000:2.0:1787582844.668303:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:2.0:1787582844.668334:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:2358:x1874416162121472:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582844.668363:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582844.668383:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b75387a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58233 expref: 55 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582844.668399:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:2.0:1787582844.668402:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582844.668439:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+54:2358:x1874416162121472:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 128us (2599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582844.668447:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:3.0:1787582844.685646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582844.685918:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162121856 00000100:00100000:0.0:1787582844.685932:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162121856 00000100:00100000:2.0:1787582844.686083:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 47 00000100:00100000:2.0:1787582844.686098:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+54:11489:x1874416162121856:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:2.0:1787582844.686521:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:11489:x1874416162121856:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 426us (887us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787582844.686531:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 47 00000100:00100000:2.0:1787582844.874842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582844.875007:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162122112 00000100:00100000:1.0:1787582844.875021:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162122112 00000100:00100000:1.0:1787582844.875105:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 167 00000100:00100000:1.0:1787582844.875127:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:11507:x1874416162122112:12345-192.168.206.20@tcp:101:cat.0 00010000:00010000:1.0:1787582844.875159:0:12083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582844.875194:0:12083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b75387b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5823a expref: -99 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.875986:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b75387c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.876004:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b75387c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.876017:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b75387c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582844.876029:0:12083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787582844.877012:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b75387b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5823a expref: 58 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.877041:0:12083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b75387c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5823a expref: 57 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.877050:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:1.0:1787582844.877054:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787582844.877057:0:12083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7e00, rc 0) 00000100:00100000:1.0:1787582844.877611:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:11507:x1874416162122112:12345-192.168.206.20@tcp:101:cat.0 Request processed in 2494us (2779us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787582844.877622:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 167 00000100:00100000:1.0:1787582844.888440:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582844.888487:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582844.888516:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582844.888560:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582844.888697:0:12082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162122496 00000100:00100000:0.0:1787582844.888709:0:12082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162122496 00000100:00100000:0.0:1787582844.888787:0:12082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162122368 00000100:00100000:0.0:1787582844.888790:0:12082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162122368 00000100:00100000:0.0:1787582844.888814:0:12082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 87 00000100:00100000:0.0:1787582844.888825:0:12082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2357:x1874416162122496:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582844.888906:0:12082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2357:x1874416162122496:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 82us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582844.888923:0:12082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 87 00000100:00100000:0.0:1787582844.888950:0:12082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 88 00000100:00100000:0.0:1787582844.888957:0:12082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2357:x1874416162122368:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582844.888986:0:12082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2357:x1874416162122368:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 30us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582844.888992:0:12082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 88 00000100:00100000:3.0:1787582844.889501:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162122240 00000100:00100000:3.0:1787582844.889508:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162122240 00000100:00100000:3.0:1787582844.889551:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 296 00000100:00100000:3.0:1787582844.889559:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2357:x1874416162122240:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582844.889605:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2357:x1874416162122240:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 47us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582844.889612:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 296 00000100:00080000:1.0:1787582844.890809:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787582844.890835:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787582844.890932:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162122624 00000100:00100000:2.0:1787582844.890951:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162122624 00000100:00100000:2.0:1787582844.891022:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 154 00000100:00100000:2.0:1787582844.891031:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162122624:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582844.891093:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b35df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+5:2357:x1874416162122624:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 63us (2532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582844.891099:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 154 00000100:00080000:1.0:1787582844.891340:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582844.914165:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582844.914346:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162122752 00000100:00100000:3.0:1787582844.914359:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162122752 00000100:00100000:3.0:1787582844.914435:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 168 00000100:00100000:3.0:1787582844.914447:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:11508:x1874416162122752:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:3.0:1787582844.914477:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582844.914508:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75387ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58241 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.914604:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75387d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.914620:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75387d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.914633:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75387d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582844.914702:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787582844.914706:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787582844.914728:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75387d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.914773:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75387ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58241 expref: 59 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.914793:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75387d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58241 expref: 58 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.914803:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:3.0:1787582844.914806:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787582844.914810:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0600, rc 0) 00000100:00100000:3.0:1787582844.914871:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+58:11508:x1874416162122752:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 426us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582844.914878:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 168 00000100:00100000:2.0:1787582844.928287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582844.928487:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162123136 00000100:00100000:3.0:1787582844.928499:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162123136 00000100:00100000:3.0:1787582844.928569:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 48 00000100:00100000:3.0:1787582844.928581:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+58:11508:x1874416162123136:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:3.0:1787582844.929086:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+59:11508:x1874416162123136:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 505us (811us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787582844.929096:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 48 00000100:00100000:0.0:1787582844.934800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582844.934900:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162123264 00000100:00100000:3.0:1787582844.935015:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162123264 00000100:00100000:3.0:1787582844.935132:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:3.0:1787582844.935150:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c59050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+59:11508:x1874416162123264:12345-192.168.206.20@tcp:103:lfs.0 00010000:00010000:3.0:1787582844.935179:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787582844.935210:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538765 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58225 expref: 59 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.935256:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b75387c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5823a expref: 58 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.935270:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538670 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581e6 expref: 57 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.935282:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acce00) 00010000:00010000:3.0:1787582844.935294:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582844.935411:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c59050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:11508:x1874416162123264:12345-192.168.206.20@tcp:103:lfs.0 Request processed in 268us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582844.935418:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:0.0:1787582844.937974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582844.938073:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162123392 00000100:00100000:1.0:1787582844.938084:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162123392 00000100:00100000:1.0:1787582844.938239:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 169 00000100:00100000:1.0:1787582844.938251:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:11508:x1874416162123392:12345-192.168.206.20@tcp:58:lfs.0 00010000:00010000:1.0:1787582844.938471:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b75387dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.938490:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b75387dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582844.938503:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b75387dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787582844.938781:0:12083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1787582844.938921:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:11508:x1874416162123392:12345-192.168.206.20@tcp:58:lfs.0 Request processed in 665us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582844.938930:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 169 00000100:00100000:1.0:1787582844.954077:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582844.954186:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162123520 00000100:00100000:3.0:1787582844.954198:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162123520 00000100:00100000:3.0:1787582844.954272:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 170 00000100:00100000:3.0:1787582844.954283:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:11510:x1874416162123520:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:3.0:1787582844.954310:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582844.954366:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75387e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58248 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954446:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75387ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954462:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75387ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954475:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75387ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954502:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75387f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954510:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75387f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954517:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75387f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954647:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75387f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954656:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75387f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954663:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75387f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582844.954703:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787582844.954708:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787582844.954728:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75387f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954740:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75387f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954750:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75387ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954757:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75387ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954773:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75387ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954780:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582844.954785:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75387ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954792:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75387ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954806:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:3.0:1787582844.954809:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582844.954814:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75387ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954821:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75387ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954835:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75387f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954841:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75387f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954847:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75387f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954852:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582844.954855:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75387f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954869:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75387f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954877:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da583acc600) 00010000:00010000:3.0:1787582844.954879:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582844.954881:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75387f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954887:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75387f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954918:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75387e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58248 expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954933:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75387f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58248 expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582844.954941:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da58533f700) 00010000:00010000:3.0:1787582844.954943:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787582844.954945:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1600, rc 0) 00000100:00100000:3.0:1787582844.955012:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:11510:x1874416162123520:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 731us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582844.955019:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 170 00000100:00100000:3.0:1787582845.008668:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787582845.008699:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186239360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787582845.008782:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582845.014192:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186239360 00000100:00100000:2.0:1787582845.014211:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186239360 00000100:00100000:2.0:1787582845.014354:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787582845.014366:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186239360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582845.014417:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582845.014517:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186239360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (5734us total) trans 0 rc 0/0 00000100:00080000:1.0:1787582845.014728:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582845.014823:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186239360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787582845.014967:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000040:00080000:2.0:1787582845.082496:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787582845.082509:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787582845.082666:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787582845.082676:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787582845.082835:0:11695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11695:1874416186239488:192.168.206.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787582845.083266:0:11695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf3280c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582845.088988:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582845.090106:0:11695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b4fa1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11695:1874416186239488:192.168.206.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787582845.092708:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162123648 00000100:00100000:3.0:1787582845.092737:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162123648 00000100:00100000:2.0:1787582845.093094:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 171 00000100:00100000:2.0:1787582845.093108:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:11521:x1874416162123648:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787582845.093158:0:5854:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787582845.093298:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:11521:x1874416162123648:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 Request processed in 194us (4323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582845.093306:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 171 00000100:00100000:2.0:1787582845.096027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00080000:0.0:1787582845.096345:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582845.096403:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162123776 00000100:00100000:3.0:1787582845.096415:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162123776 00000100:00100000:3.0:1787582845.096473:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 172 00000100:00100000:3.0:1787582845.096484:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:11521:x1874416162123776:12345-192.168.206.20@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787582845.096568:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75387ff lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.096588:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75387ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.096603:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75387ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.100484:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538806 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.100510:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538806 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.100598:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538806 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.100644:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753880d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.100653:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753880d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.100724:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753880d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582845.100883:0:12083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787582845.100888:0:12083:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582845.100904:0:12083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753880d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.100983:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75387ff lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.100992:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75387ff lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.100999:0:12083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75387ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101007:0:12083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582845.101012:0:12083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75387ff lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101021:0:12083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75387ff lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101046:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8da5a0b68e00) 00010000:00010000:0.0:1787582845.101049:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582845.101055:0:12083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75387ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101062:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b75387ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101076:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538806 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101082:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538806 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101088:0:12083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538806 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101093:0:12083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20eee00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582845.101096:0:12083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538806 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101103:0:12083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538806 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101111:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8da5a0b68500) 00010000:00010000:0.0:1787582845.101113:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582845.101116:0:12083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538806 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101122:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538806 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101222:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753880d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101229:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753880d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101236:0:12083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753880d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101241:0:12083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efa00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582845.101244:0:12083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753880d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101251:0:12083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753880d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101258:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da58533f700) 00010000:00010000:0.0:1787582845.101260:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582845.101263:0:12083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753880d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.101269:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753880d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582845.101862:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:11521:x1874416162123776:12345-192.168.206.20@tcp:34:lhsmtool_posix.0 Request processed in 5372us (5841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582845.101875:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 172 00000100:00100000:2.0:1787582845.115911:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582845.116349:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162124032 00000100:00100000:3.0:1787582845.116358:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162124032 00000100:00100000:3.0:1787582845.116407:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 173 00000100:00100000:3.0:1787582845.116415:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:11521:x1874416162124032:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787582845.116433:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582845.116518:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538814 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5824f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.116612:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753881b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.116627:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753881b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.116638:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753881b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582845.116989:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787582845.117087:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753881b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.117096:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753881b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.117103:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753881b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.117110:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582845.117114:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753881b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.117121:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753881b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.117134:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da58533f700) 00010000:00010000:3.0:1787582845.117138:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787582845.117142:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753881b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.117148:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753881b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.117198:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538814 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5824f expref: 59 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.117209:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8da5a0b68e00) 00010000:00010000:3.0:1787582845.117212:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787582845.118552:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538814 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5824f expref: 59 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.118575:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1000, rc 0) 00000100:00100000:1.0:1787582845.120034:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+58:11521:x1874416162124032:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 3605us (4115us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1787582845.120048:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 173 00000100:00100000:3.0:1787582845.126432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582845.126625:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162124160 00000100:00100000:2.0:1787582845.126635:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162124160 00000100:00100000:2.0:1787582845.126690:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 174 00000100:00100000:2.0:1787582845.126700:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+58:11521:x1874416162124160:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787582845.126749:0:7653:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787582845.126858:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+58:11521:x1874416162124160:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 Request processed in 158us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582845.126866:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 174 00000100:00100000:1.0:1787582845.134536:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582845.134675:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162124416 00000100:00100000:3.0:1787582845.134685:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162124416 00000100:00100000:3.0:1787582845.134746:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 175 00000100:00100000:3.0:1787582845.134756:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+58:11521:x1874416162124416:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787582845.134776:0:12083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582845.134779:0:12083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787582845.134804:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75387d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58241 expref: 58 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.134823:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:3.0:1787582845.134828:0:12083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787582845.134840:0:12083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538829 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58256 expref: -99 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787582845.135227:0:12083:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787582845.135439:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b7538830 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.135849:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b7538830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.135860:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b7538830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.135910:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538829 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58256 expref: 60 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.135936:0:12083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b7538830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58256 expref: 59 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.135943:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8da583acc600) 00010000:00010000:3.0:1787582845.135946:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787582845.135948:0:12083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0c00, rc 0) 00000100:00100000:3.0:1787582845.135999:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+59:11521:x1874416162124416:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 1245us (1473us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787582845.136006:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 175 00000100:00100000:1.0:1787582845.153690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582845.154539:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162124672 00000100:00100000:0.0:1787582845.154557:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162124672 00000100:00100000:0.0:1787582845.154644:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 176 00000100:00100000:0.0:1787582845.154681:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+59:11521:x1874416162124672:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787582845.154755:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582845.154786:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0c00/0xa113d808b7538830 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58256 expref: 59 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.154809:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8da583acc600) 00010000:00010000:0.0:1787582845.154820:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787582845.154847:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753883e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.154863:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753883e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.154874:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753883e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.154890:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538845 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa60880da bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.154897:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa60880da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.154915:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa60880da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.155007:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753883e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.155015:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753883e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.155032:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753883e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.155039:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efa00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582845.155044:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753883e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.155053:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753883e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.155062:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:0.0:1787582845.155065:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582845.155069:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753883e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.155075:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753883e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.155086:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa60880da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.155092:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538845 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa60880da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.155099:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa60880da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.155104:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20eee00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582845.155106:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa60880da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.155119:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538845 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa60880da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.155127:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa60880da (ffff8da5a0b68500) 00010000:00010000:0.0:1787582845.155129:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582845.155132:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538845 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa60880da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.155149:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538845 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa60880da bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582845.155261:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+58:11521:x1874416162124672:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 Request processed in 582us (1579us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787582845.155269:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 176 00000100:00100000:3.0:1787582845.163020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582845.165844:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162124800 00000100:00100000:1.0:1787582845.165858:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162124800 00000100:00100000:1.0:1787582845.165920:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 177 00000100:00100000:1.0:1787582845.165943:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+58:11521:x1874416162124800:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787582845.165963:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582845.165988:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b753884c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5825d expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.166024:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538853 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.166043:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.166054:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.166143:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b753884c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5825d expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.166162:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5825d expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.166183:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8da58533fe00) 00010000:00010000:1.0:1787582845.166186:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787582845.166189:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6e00, rc 0) 00000100:00100000:1.0:1787582845.166264:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+59:11521:x1874416162124800:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 322us (3252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582845.166272:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 177 00000100:00100000:1.0:1787582845.174864:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582845.175068:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162125056 00000100:00100000:3.0:1787582845.175080:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162125056 00000100:00100000:3.0:1787582845.175153:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 178 00000100:00100000:3.0:1787582845.175165:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+59:11521:x1874416162125056:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787582845.175280:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b753885a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.175300:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b753885a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.175313:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b753885a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787582845.176224:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787582845.176238:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386182919300ns, next at 387182916649ns, rc = 0 00000004:00010000:3.0:1787582845.176864:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d118b2fe reply state 00000000d7ec4ee1 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b753885a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582845.176909:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787582845.177050:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+61:11521:x1874416162125056:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 Request processed in 1883us (2195us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787582845.177059:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 178 00010000:00010000:3.0:1787582845.188674:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b753885a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.188696:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b753885a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.188705:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b753885a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.188712:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582845.188718:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b753885a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.188727:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b753885a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.188747:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8da58533fe00) 00010000:00010000:3.0:1787582845.188751:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787582845.188755:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b753885a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.188762:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0a00/0xa113d808b753885a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582845.191357:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582845.191678:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162125184 00000100:00100000:3.0:1787582845.191690:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162125184 00000100:00100000:3.0:1787582845.191789:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 179 00000100:00100000:3.0:1787582845.191800:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:11521:x1874416162125184:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787582845.191847:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582845.191873:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538861 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58264 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.192134:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538861 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58264 expref: 61 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.192218:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538861 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58264 expref: 61 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.192243:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8da58533fe00) 00010000:00010000:3.0:1787582845.192247:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787582845.192251:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1400, rc 0) 00000100:00100000:3.0:1787582845.192353:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+61:11521:x1874416162125184:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 555us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582845.192361:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 179 00000100:00100000:2.0:1787582845.202894:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582845.203192:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162125312 00000100:00100000:3.0:1787582845.203205:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162125312 00000100:00100000:3.0:1787582845.203275:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 51 00000100:00100000:3.0:1787582845.203286:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2360:x1874416162125312:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787582845.205934:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2360:x1874416162125312:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 Request processed in 2633us (3037us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787582845.205951:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 51 00000100:00100000:2.0:1787582845.213697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582845.213857:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162125568 00000100:00100000:3.0:1787582845.213884:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162125568 00000100:00100000:3.0:1787582845.213956:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 49 00000100:00100000:3.0:1787582845.213967:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+61:11521:x1874416162125568:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787582845.214290:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+62:11521:x1874416162125568:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 Request processed in 324us (606us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787582845.214298:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 49 00000100:00100000:2.0:1787582845.224678:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582845.225420:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162125824 00000100:00100000:3.0:1787582845.225434:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162125824 00000100:00100000:0.0:1787582845.225637:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 180 00000100:00100000:0.0:1787582845.225652:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+62:11521:x1874416162125824:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787582845.225793:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+62:11521:x1874416162125824:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 145us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582845.225801:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 180 00000100:00100000:3.0:1787582845.240794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582845.250388:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162125952 00000100:00100000:0.0:1787582845.250409:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162125952 00000100:00100000:0.0:1787582845.250496:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 181 00000100:00100000:0.0:1787582845.250576:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+62:11521:x1874416162125952:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787582845.250983:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582845.251099:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538868 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5826b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.251398:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753886f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.251418:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753886f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.251431:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753886f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582845.251472:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582845.251490:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753886f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.251533:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538868 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5826b expref: 64 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.251553:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753886f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5826b expref: 63 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.251563:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8da58533fe00) 00010000:00010000:0.0:1787582845.251566:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787582845.251570:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20efa00, rc 0) 00000100:00100000:0.0:1787582845.251647:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+63:11521:x1874416162125952:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 1140us (10865us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582845.251656:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 181 00000100:00100000:0.0:1787582845.256103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582845.258549:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162126080 00000100:00100000:1.0:1787582845.258584:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162126080 00000100:00100000:1.0:1787582845.258681:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 52 00000100:00100000:1.0:1787582845.258694:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2357:x1874416162126080:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787582845.258724:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582845.258763:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538876 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58272 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787582845.258814:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c597d, blocks: 0x1 00010000:00010000:1.0:1787582845.258841:0:6703:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=386s v=(0 0) 00010000:00010000:1.0:1787582845.258846:0:6703:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582845.258857:0:6703:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538876 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58272 expref: 8 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.258884:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538876 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58272 expref: 8 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.258905:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6c00, rc 0) 00000100:00100000:1.0:1787582845.259001:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2357:x1874416162126080:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 309us (2908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582845.259013:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 52 00000100:00100000:1.0:1787582845.270439:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582845.270526:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162126336 00000100:00100000:0.0:1787582845.270538:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162126336 00000100:00100000:0.0:1787582845.270619:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 182 00000100:00100000:0.0:1787582845.270629:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+63:11521:x1874416162126336:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787582845.270756:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+63:11521:x1874416162126336:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 127us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582845.270764:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 182 00000100:00100000:0.0:1787582845.275018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582845.275096:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162126464 00000100:00100000:3.0:1787582845.275107:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162126464 00000100:00100000:3.0:1787582845.275187:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 53 00000100:00100000:3.0:1787582845.275198:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:11521:x1874416162126464:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787582845.275220:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582845.275242:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce528696/0xa113d808b753887d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58279 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.275277:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538876 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58272 expref: 9 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.275288:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582845.275292:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582845.275298:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce528696/0xa113d808b753887d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58279 expref: 9 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.275366:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538876 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58272 expref: 9 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.275406:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538876 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58272 expref: 9 pid: 6703 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582845.275423:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb2b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1874416186239616:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582845.275535:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b51f00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582845.286720:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582845.286764:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162126592 00000100:00100000:3.0:1787582845.286787:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162126592 00010000:00010000:3.0:1787582845.286841:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538876 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58272 expref: 10 pid: 6703 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582845.286889:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 70 00000100:00100000:3.0:1787582845.286900:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483511880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:2360:x1874416162126592:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582845.286919:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582845.286947:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538876 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58272 expref: 10 pid: 6703 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.286964:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538876 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58272 expref: 10 pid: 6703 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.286993:0:5839:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582845.286999:0:5839:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582845.287010:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce528696/0xa113d808b753887d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58279 expref: 10 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.287043:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce528696/0xa113d808b753887d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58279 expref: 10 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.287092:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ce528696/0xa113d808b753887d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58279 expref: 10 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582845.287109:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5839:1874416186239744:192.168.206.20@tcp:105: 00000100:00100000:3.0:1787582845.287221:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b51f03c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787582845.288065:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538876 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58272 expref: 10 pid: 6703 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582845.288086:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb2b1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1874416186239616:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582845.288119:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce528696/0xa113d808b753887d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58279 expref: 9 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.288134:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0a00, rc 0) 00000100:00100000:0.0:1787582845.288215:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:11521:x1874416162126464:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 13018us (13209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582845.288225:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 53 00000100:00100000:3.0:1787582845.294268:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582845.294503:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5839:1874416186239744:192.168.206.20@tcp:105: 00010000:00010000:0.0:1787582845.294532:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582845.294594:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483511880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2360:x1874416162126592:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 7695us (7887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582845.294605:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 70 00000100:00100000:1.0:1787582845.296366:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162126720 00000100:00100000:1.0:1787582845.296387:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162126720 00002000:00100000:1.0:1787582845.296463:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8da5bb6e4000 x1874416162126720/t0(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:311/0 lens 504/0 e 0 to 0 dl 1787582856 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787582845.296477:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5bb6e4000 with x1874416162126720 ext(0->8) 00002000:00010000:1.0:1787582845.297665:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da5bb6e4000 00000100:00100000:1.0:1787582845.297717:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 4 00000100:00100000:1.0:1787582845.297730:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2360:x1874416162126720:12345-192.168.206.20@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787582845.298909:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb6e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:2360:x1874416162126720:12345-192.168.206.20@tcp:4:lhsmtool_posix.0 Request processed in 1175us (4648us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787582845.303699:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 4 00002000:00100000:1.0:1787582845.303721:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8da5bb6e4000 x1874416162126720/t4294967314(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:311/0 lens 504/448 e 0 to 0 dl 1787582856 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787582845.303733:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5bb6e4000 with x1874416162126720 ext(0->8) 00002000:00010000:1.0:1787582845.303741:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da5bb6e4000 00000100:00100000:3.0:1787582845.305076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582845.305974:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162126848 00000100:00100000:1.0:1787582845.305991:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162126848 00000100:00100000:1.0:1787582845.306071:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 183 00000100:00100000:1.0:1787582845.306082:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+63:11521:x1874416162126848:12345-192.168.206.20@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1787582845.396628:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582845.435895:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+63:11521:x1874416162126848:12345-192.168.206.20@tcp:44:lhsmtool_posix.0 Request processed in 129799us (130813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582845.435918:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 183 00000001:00080000:3.0:1787582845.435967:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967421 is committed 00000001:00080000:3.0:1787582845.435983:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000004:00080000:3.0:1787582845.436042:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787582845.436068:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8da5bf328300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787582845.436073:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da5bb2a0a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8da5bf328d80 00000020:00080000:3.0:1787582845.436077:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da5bb2a0d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8da5bf22b000 00000001:00080000:3.0:1787582845.436103:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1787582845.436111:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:3.0:1787582845.436157:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1787582845.436395:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787582845.436527:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186239872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787582845.436624:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582845.436705:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186239872 00000100:00100000:3.0:1787582845.436713:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186239872 00000100:00100000:3.0:1787582845.436763:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787582845.436772:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186239872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787582845.436921:0:8218:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787582845.436925:0:8218:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787582845 00002000:00010000:3.0:1787582845.436928:0:8218:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787582845.436930:0:8218:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787582845 -> 1787582845 00002000:00010000:3.0:1787582845.436933:0:8218:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787582845.436964:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1874416186239872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (341us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787582845.436971:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1787582845.437013:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8da58b3ef480/2, rc 0, transno 4294967315 00000100:00100000:3.0:1787582845.437019:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186239872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787582845.440434:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186240000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787582845.442136:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582845.445875:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186240000 00000100:00100000:0.0:1787582845.445894:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186240000 00000100:00100000:0.0:1787582845.445968:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787582845.445986:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186240000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787582845.446026:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1787582845.446070:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8c597a, atime: 0x6a8c597a, ctime: 0x6a8c597a, blocks: 0xb 00010000:00010000:0.0:1787582845.446079:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2b6b068/0xa113d808b7538884 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.446100:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1787582845.446105:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582845.446113:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2b6b068/0xa113d808b7538884 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.446132:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2b6b068/0xa113d808b7538884 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.446145:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2b6b068/0xa113d808b7538884 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.446154:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2b6b068/0xa113d808b7538884 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.446186:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787582845.446868:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874416186240000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 883us (4739us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787582845.446878:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1787582845.446909:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787582845.447487:0:11179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582845.447498:0:11179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2b6b068/0xa113d808b7538884 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.447510:0:11179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20eee00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582845.447516:0:11179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2b6b068/0xa113d808b7538884 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.447527:0:11179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2b6b068/0xa113d808b7538884 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.447558:0:11179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2b6b068/0xa113d808b7538884 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.447567:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2b6b068/0xa113d808b7538884 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.447591:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582845.447592:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582845.447594:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582845.447635:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1787582845.447641:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1787582845.447669:0:3312:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8da5bf226d80 x1874416186240000/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787582861 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787582845.447683:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8da5bf226d80/2, rc 0, transno 4294967307 00000100:00100000:3.0:1787582845.447689:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186240000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787582845.450669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582845.450857:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162126976 00000100:00100000:1.0:1787582845.450868:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162126976 00000100:00100000:1.0:1787582845.450934:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 56 00000100:00100000:1.0:1787582845.450945:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:2359:x1874416162126976:12345-192.168.206.20@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787582845.535477:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:0.0:1787582845.535516:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:1.0:1787582845.538902:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2359:x1874416162126976:12345-192.168.206.20@tcp:16:lhsmtool_posix.0 Request processed in 87942us (88230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582845.539215:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 56 00000100:00100000:1.0:1787582845.547142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582845.547512:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162127232 00000100:00100000:0.0:1787582845.547524:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162127232 00000100:00100000:0.0:1787582845.547583:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 184 00000100:00100000:0.0:1787582845.547594:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:11521:x1874416162127232:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787582845.547659:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582845.547704:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753886f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5826b expref: 18 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.547733:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8da58533fe00) 00010000:00010000:0.0:1787582845.547739:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787582845.547774:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753888b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.547789:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753888b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.547801:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753888b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787582845.548089:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc6e54aa reply state 000000002e85f37d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753888b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582845.548101:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787582845.548222:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:11521:x1874416162127232:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 Request processed in 628us (1087us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1787582845.548230:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 184 00010000:00010000:0.0:1787582845.554044:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753888b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.554068:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753888b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.554085:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753888b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.554093:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efe00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582845.554098:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753888b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.554107:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753888b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.554130:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8da58533fe00) 00010000:00010000:0.0:1787582845.554134:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582845.554148:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753888b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.554157:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753888b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582845.558604:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582845.558952:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162127360 00000100:00100000:3.0:1787582845.558963:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162127360 00000100:00100000:3.0:1787582845.559025:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 57 00000100:00100000:3.0:1787582845.559037:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2360:x1874416162127360:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787582845.559465:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787582845.559470:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787582845 -> 1787582844 00002000:00010000:3.0:1787582845.559473:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787582842 00002000:00010000:3.0:1787582845.559475:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787582845 -> 1787582844 00002000:00010000:3.0:1787582845.559478:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787582845.561092:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2360:x1874416162127360:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 Request processed in 2053us (2497us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787582845.561104:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 57 00000100:00100000:3.0:1787582845.573864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582845.574990:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162127616 00000100:00100000:1.0:1787582845.575022:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162127616 00000100:00100000:1.0:1787582845.575091:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 185 00000100:00100000:1.0:1787582845.575102:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:11521:x1874416162127616:12345-192.168.206.20@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787582845.575201:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538892 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.575220:0:5855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538853 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5825d expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.575232:0:5855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538892 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.575272:0:5855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5825d expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.575289:0:5855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538853 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5825d expref: 18 pid: 5852 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582845.575305:0:5855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b5331880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1874416186240128:192.168.206.20@tcp:104: 00000100:00100000:1.0:1787582845.575527:0:5855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b5034180 going to sleep for 11 seconds 00000100:00100000:3.0:1787582845.581461:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582845.581501:0:5855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b5331880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5855:1874416186240128:192.168.206.20@tcp:104: 00000100:00100000:2.0:1787582845.581652:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162127744 00000100:00100000:2.0:1787582845.581661:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162127744 00010000:00010000:1.0:1787582845.581795:0:5855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538892 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582845.581905:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538853 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5825d expref: 19 pid: 5852 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582845.581942:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 71 00000100:00100000:2.0:1787582845.581952:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:2360:x1874416162127744:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582845.581968:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582845.581976:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538853 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5825d expref: 19 pid: 5852 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582845.581990:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5825d expref: 19 pid: 5852 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582845.582014:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538853 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5825d expref: 19 pid: 5852 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582845.582032:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8da58533fe00) 00010000:00010000:2.0:1787582845.582052:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538892 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582845.582063:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582845.582072:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538892 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582845.582100:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582845.582160:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf285f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:2360:x1874416162127744:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 209us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582845.582178:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 71 00010000:00010000:1.0:1787582845.582236:0:5855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.582244:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.582286:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538892 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.582295:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538892 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.582302:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538892 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.582308:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582845.582313:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538892 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.582349:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538892 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.582360:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8da58533fe00) 00010000:00010000:1.0:1787582845.582364:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787582845.582368:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538892 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.582374:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538892 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582845.582424:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+17:11521:x1874416162127616:12345-192.168.206.20@tcp:55:lhsmtool_posix.0 Request processed in 7325us (8573us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787582845.582433:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 185 00000100:00100000:3.0:1787582845.585240:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582845.585421:0:12082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162127872 00000100:00100000:0.0:1787582845.585433:0:12082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162127872 00000100:00100000:0.0:1787582845.585488:0:12082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 58 00000100:00100000:0.0:1787582845.585498:0:12082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2359:x1874416162127872:12345-192.168.206.20@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787582845.585560:0:12082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538899 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.585585:0:12082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce528696/0xa113d808b753887d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58279 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.585595:0:12082:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582845.585615:0:12082:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787582845.585621:0:12082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538899 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.585665:0:12082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce528696/0xa113d808b753887d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58279 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.586150:0:12082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce528696/0xa113d808b753887d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58279 expref: 8 pid: 6705 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582845.586178:0:12082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8c36300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12082:1874416186240256:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582845.586281:0:12082:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c240 going to sleep for 11 seconds 00000100:00100000:1.0:1787582845.591578:0:12082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8c36300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12082:1874416186240256:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582845.591627:0:12082:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538899 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582845.592361:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582845.593780:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162128000 00000100:00100000:1.0:1787582845.593798:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162128000 00010000:00010000:1.0:1787582845.593842:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce528696/0xa113d808b753887d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58279 expref: 9 pid: 6705 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582845.593879:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 72 00000100:00100000:1.0:1787582845.593889:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:2359:x1874416162128000:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582845.593905:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582845.593930:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce528696/0xa113d808b753887d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58279 expref: 9 pid: 6705 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.593947:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce528696/0xa113d808b753887d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58279 expref: 9 pid: 6705 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.593973:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce528696/0xa113d808b753887d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58279 expref: 9 pid: 6705 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.593989:0:8463:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787582845.593994:0:8463:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787582845.594001:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538899 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.594013:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538899 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.594062:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582845.594123:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2359:x1874416162128000:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 234us (1766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582845.594132:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 72 00010000:00010000:3.0:1787582845.594182:0:12082:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538899 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.594196:0:12082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538899 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.594225:0:12082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538899 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.594235:0:12082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538899 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.594243:0:12082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538899 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.594251:0:12082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efe00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582845.594257:0:12082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538899 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.594266:0:12082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538899 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.594286:0:12082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538899 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.594296:0:12082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538899 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582845.594364:0:12082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2359:x1874416162127872:12345-192.168.206.20@tcp:1:lhsmtool_posix.0 Request processed in 8866us (9137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582845.594372:0:12082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 58 00000100:00100000:1.0:1787582845.617663:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582845.617750:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162128256 00000100:00100000:0.0:1787582845.617762:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162128256 00000100:00100000:0.0:1787582845.617851:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 186 00000100:00100000:0.0:1787582845.617863:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+17:11521:x1874416162128256:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787582845.618766:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75388a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.618805:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75388a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.618819:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75388a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.619158:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75388a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.619187:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538861 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58264 expref: 18 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.619213:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75388a7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.619257:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538861 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58264 expref: 18 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.619277:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538861 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58264 expref: 18 pid: 7653 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582845.619296:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8c34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186240384:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582845.620012:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787582845.635856:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582845.636499:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162128384 00000100:00100000:1.0:1787582845.636512:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162128384 00010000:00010000:1.0:1787582845.636561:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538861 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58264 expref: 19 pid: 7653 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582845.636613:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 73 00000100:00100000:1.0:1787582845.636624:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:2360:x1874416162128384:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582845.636641:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582845.636648:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538861 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58264 expref: 19 pid: 7653 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.636664:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538861 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58264 expref: 19 pid: 7653 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.636700:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8da58533fe00) 00010000:00010000:1.0:1787582845.636707:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75388a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.636718:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75388a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.636727:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75388a7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582845.636761:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582845.636823:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:2360:x1874416162128384:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 201us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582845.636831:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 73 00010000:00010000:0.0:1787582845.637359:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538861 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58264 expref: 18 pid: 7653 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582845.637381:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8c34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186240384:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582845.637414:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75388a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.637425:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75388a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.637431:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75388a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787582845.637683:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1787582845.637870:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1787582845.637937:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1787582845.638056:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8c34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874416186240512:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787582845.638122:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582845.638357:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da585e82540 going to sleep for 11 seconds 00000100:00100000:3.0:1787582845.640510:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186240512 00000100:00100000:3.0:1787582845.640527:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186240512 00000100:00100000:3.0:1787582845.640601:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787582845.640614:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1874416186240512:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787582845.640861:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1874416186240512:12345-0@lo:1000:mdt00_000.0 Request processed in 250us (2738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582845.640870:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787582845.646455:0:5852:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787582845.646466:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8da58b3ef480, transno 4294967315 00000100:00100000:3.0:1787582845.646494:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8c34700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874416186240512:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787582845.647080:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787582845.647181:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf285500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874416186240640:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787582845.647258:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582845.647301:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fd0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787582845.647986:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186240640 00000100:00100000:0.0:1787582845.647996:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186240640 00000100:00100000:0.0:1787582845.649095:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787582845.649112:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5852:x1874416186240640:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787582845.649483:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1874416186240640:12345-0@lo:1000:mdt00_000.0 Request processed in 375us (2222us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1787582845.649492:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787582845.651098:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf285500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874416186240640:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787582845.651159:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75388a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.651182:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75388a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.651191:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75388a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.651198:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efe00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582845.651204:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75388a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.651213:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75388a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.651232:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8da58533fe00) 00010000:00010000:3.0:1787582845.651234:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787582845.651240:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75388a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.651246:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b75388a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.651286:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b75387dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.651294:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b75387dc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.651299:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b75387dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.651344:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582845.651347:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b75387dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.651353:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b75387dc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.651363:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da58533f700) 00010000:00010000:3.0:1787582845.651366:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787582845.651370:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b75387dc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.651375:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b75387dc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.652485:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.652509:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75387f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58248 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.652520:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388ae lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.652564:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75387f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58248 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.652972:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75387f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58248 expref: 21 pid: 5852 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582845.653011:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf284a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186240768:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582845.653116:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fd0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787582845.670502:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582845.670545:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162128512 00000100:00100000:0.0:1787582845.670558:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162128512 00010000:00010000:0.0:1787582845.670611:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75387f8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58248 expref: 22 pid: 5852 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582845.670667:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 74 00000100:00100000:0.0:1787582845.670679:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+22:2359:x1874416162128512:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787582845.670698:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582845.670706:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75387f8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58248 expref: 22 pid: 5852 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.670723:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75387f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58248 expref: 22 pid: 5852 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.670752:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da58533f700) 00010000:00010000:0.0:1787582845.670758:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.670797:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.670806:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388ae lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.670829:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582845.670895:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+22:2359:x1874416162128512:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 218us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582845.670914:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 74 00010000:00010000:3.0:1787582845.671202:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75387f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58248 expref: 21 pid: 5852 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582845.671221:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf284a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186240768:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582845.671247:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671257:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671264:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671279:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671286:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671294:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671306:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582845.671311:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671340:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671360:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da58533f700) 00010000:00010000:3.0:1787582845.671363:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582845.671367:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671374:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671385:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75388a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671391:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75388a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671397:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75388a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671402:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582845.671405:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75388a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671411:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75388a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671419:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da58533f700) 00010000:00010000:3.0:1787582845.671422:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787582845.671425:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75388a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.671432:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b75388a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582845.672129:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+20:11521:x1874416162128256:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 54261us (54474us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787582845.672140:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 186 00000020:00080000:3.0:1787582845.672145:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787582845.672465:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787582845.672471:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787582845.673357:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787582845.673367:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787582845.686063:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582845.686181:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162128768 00000100:00100000:0.0:1787582845.686193:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162128768 00000100:00100000:0.0:1787582845.686258:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 50 00000100:00100000:0.0:1787582845.686269:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583666c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+20:11521:x1874416162128768:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787582845.687038:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787582845.687141:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1787582845.687204:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.687224:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.687238:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.687248:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.687255:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.687269:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582845.687287:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787582845.687411:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583666c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+22:11521:x1874416162128768:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 Request processed in 1142us (1362us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787582845.687421:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 50 00000020:00080000:0.0:1787582845.687429:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787582845.688386:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582845.688396:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.688405:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee200 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582845.688410:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.688420:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.688436:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8da5a0b68300) 00010000:00010000:3.0:1787582845.688439:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787582845.688444:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388b5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.688450:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582845.688469:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582845.688471:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582845.688473:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582846.033384:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787582846.033407:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186240896:0@lo:400:kworker.0 00000100:00100000:1.0:1787582846.033473:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582846.033547:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186240896 00000100:00100000:1.0:1787582846.033555:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186240896 00000100:00100000:1.0:1787582846.033598:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787582846.033607:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3314:x1874416186240896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582846.033654:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3314:x1874416186240896:12345-0@lo:400:kworker.0 Request processed in 48us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582846.033662:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787582846.033704:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:615b3d9a-8a7c-4227-a987-f23a2209c536:3314:1874416186240896:0@lo:400:kworker.0 00000100:00100000:3.0:1787582846.034118:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186241152:0@lo:400:kworker.0 00000100:00100000:3.0:1787582846.034415:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582846.034454:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787582846.034460:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186241280:0@lo:400:kworker.0 00000100:00100000:3.0:1787582846.034485:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582846.034515:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186241152 00000100:00100000:3.0:1787582846.034520:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186241152 00000100:00100000:3.0:1787582846.034553:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787582846.034560:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874416186241152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582846.034597:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf284000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874416186241152:12345-0@lo:400:kworker.0 Request processed in 37us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582846.034603:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787582846.034620:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186241280 00000100:00100000:3.0:1787582846.034623:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186241280 00000100:00100000:3.0:1787582846.034649:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787582846.034655:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186241280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582846.034684:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186241280:12345-0@lo:400:kworker.0 Request processed in 29us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582846.034691:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787582846.034718:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186241280:0@lo:400:kworker.0 00000100:00100000:3.0:1787582846.034726:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186241152:0@lo:400:kworker.0 00000100:00080000:3.0:1787582846.034745:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582846.034899:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186241024:0@lo:400:kworker.0 00000100:00100000:1.0:1787582846.034935:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582846.034959:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186241536:0@lo:400:kworker.0 00000100:00100000:1.0:1787582846.034980:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582846.034994:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787582846.034999:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874416186241408:0@lo:400:kworker.0 00000100:00100000:1.0:1787582846.035018:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582846.035042:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186241024 00000100:00100000:1.0:1787582846.035045:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186241024 00000100:00100000:1.0:1787582846.035064:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186241408 00000100:00100000:1.0:1787582846.035073:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186241408 00000100:00100000:1.0:1787582846.035092:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787582846.035098:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186241024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582846.035132:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186241024:12345-0@lo:400:kworker.0 Request processed in 34us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582846.035149:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787582846.035159:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787582846.035175:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874416186241408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582846.035203:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874416186241408:12345-0@lo:400:kworker.0 Request processed in 30us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582846.035996:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787582846.036035:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874416186241408:0@lo:400:kworker.0 00000100:00100000:1.0:1787582846.036045:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186241024:0@lo:400:kworker.0 00000100:00100000:3.0:1787582846.036345:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186241536 00000100:00100000:3.0:1787582846.036350:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186241536 00000100:00100000:3.0:1787582846.036383:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787582846.036390:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874416186241536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582846.036445:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874416186241536:12345-0@lo:400:kworker.0 Request processed in 55us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582846.036451:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1787582846.036478:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582846.036883:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186241536:0@lo:400:kworker.0 00000040:00080000:0.0:1787582846.080187:0:12474:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787582846.080197:0:12474:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787582846.080249:0:12474:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787582846.080255:0:12474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787582846.292183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582846.292248:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162129024 00000100:00100000:1.0:1787582846.292257:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162129024 00000100:00100000:1.0:1787582846.292345:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 187 00000100:00100000:1.0:1787582846.292355:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+22:11532:x1874416162129024:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:1.0:1787582846.292377:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582846.292396:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b75388bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58280 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.292625:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b75388c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.292640:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b75388c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.292659:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b75388c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582846.292670:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1787582846.292830:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b75388bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58280 expref: 25 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.292846:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b75388c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58280 expref: 24 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.292854:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:1.0:1787582846.292857:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787582846.292861:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7e00, rc 0) 00000100:00100000:1.0:1787582846.292909:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+24:11532:x1874416162129024:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 556us (735us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1787582846.292917:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 187 00000100:00100000:0.0:1787582846.306760:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582846.306797:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162129152 00000100:00100000:0.0:1787582846.306805:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162129152 00000100:00100000:0.0:1787582846.306851:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 188 00000100:00100000:0.0:1787582846.306860:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+24:11532:x1874416162129152:12345-192.168.206.20@tcp:34:lfs.0 00010000:00010000:0.0:1787582846.306931:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75388d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.306947:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75388d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.306957:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75388d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.306973:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75388d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.306987:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75388d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.306994:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75388d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307276:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307286:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307293:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787582846.307350:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307362:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75388d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307368:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75388d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307374:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75388d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307381:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efa00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582846.307384:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75388d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307391:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75388d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307410:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:0.0:1787582846.307413:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582846.307418:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75388d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307424:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b75388d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307435:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75388d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307440:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75388d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307446:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75388d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307451:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20eee00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582846.307453:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75388d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307459:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75388d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307466:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da5a0b68300) 00010000:00010000:0.0:1787582846.307469:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582846.307472:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75388d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307476:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b75388d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307499:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307505:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307510:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307515:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582846.307518:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307524:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307531:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da5a0b68500) 00010000:00010000:0.0:1787582846.307533:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582846.307535:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.307541:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b75388df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582846.307620:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+24:11532:x1874416162129152:12345-192.168.206.20@tcp:34:lfs.0 Request processed in 760us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582846.307629:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 188 00000100:00100000:1.0:1787582846.342284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582846.342397:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162129408 00000100:00100000:3.0:1787582846.342408:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162129408 00000100:00100000:3.0:1787582846.342470:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 189 00000100:00100000:3.0:1787582846.342481:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+24:11535:x1874416162129408:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:3.0:1787582846.342499:0:12083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582846.342518:0:12083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58287 expref: -99 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.342597:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75388ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.342610:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75388ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.342620:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75388ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.342634:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75388f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.342640:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75388f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.342646:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75388f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.342963:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75388fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.342972:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75388fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.342989:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75388fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582846.342998:0:12083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787582846.343086:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75388ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343093:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75388ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343100:0:12083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75388ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343105:0:12083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582846.343109:0:12083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75388ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343116:0:12083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75388ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343127:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:3.0:1787582846.343129:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582846.343147:0:12083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75388ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343154:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75388ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343176:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75388f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343183:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75388f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343194:0:12083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75388f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343199:0:12083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582846.343202:0:12083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75388f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343207:0:12083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75388f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343215:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da583acce00) 00010000:00010000:3.0:1787582846.343445:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582846.343450:0:12083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75388f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343457:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75388f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343504:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75388e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58287 expref: 27 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343517:0:12083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75388fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58287 expref: 26 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.343524:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acc800) 00010000:00010000:3.0:1787582846.343526:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787582846.343529:0:12083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0400, rc 0) 00000100:00100000:3.0:1787582846.343595:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:11535:x1874416162129408:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 1116us (1319us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787582846.343610:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 189 00000100:00100000:1.0:1787582846.348117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582846.348745:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162129536 00000100:00100000:3.0:1787582846.348756:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162129536 00000100:00100000:3.0:1787582846.348808:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 190 00000100:00100000:3.0:1787582846.348817:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:11535:x1874416162129536:12345-192.168.206.20@tcp:54:lfs.0 00010000:00010000:3.0:1787582846.348889:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7538909 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.348917:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7538909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.348929:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7538909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.348955:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7538909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.348962:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7538909 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.348968:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7538909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.348974:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582846.348978:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7538909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.348984:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7538909 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.348995:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acc800) 00010000:00010000:3.0:1787582846.349016:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787582846.349021:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7538909 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.349027:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1800/0xa113d808b7538909 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582846.349109:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:11535:x1874416162129536:12345-192.168.206.20@tcp:54:lfs.0 Request processed in 292us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582846.349116:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 190 00000100:00100000:2.0:1787582846.360777:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582846.361079:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162129792 00000100:00100000:0.0:1787582846.361090:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162129792 00000100:00100000:0.0:1787582846.361154:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 51 00000100:00100000:0.0:1787582846.361185:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:11535:x1874416162129792:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:0.0:1787582846.361442:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+27:11535:x1874416162129792:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 259us (673us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787582846.361449:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 51 00000100:00100000:1.0:1787582846.395970:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582846.396061:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162130048 00000100:00100000:0.0:1787582846.396070:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162130048 00000100:00100000:0.0:1787582846.396128:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 191 00000100:00100000:0.0:1787582846.396138:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+27:11069:x1874416162130048:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:0.0:1787582846.396170:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582846.396190:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538910 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5828e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.396284:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.396299:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75388fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58287 expref: 28 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.396309:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.396419:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75388fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58287 expref: 28 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.396434:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75388fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58287 expref: 28 pid: 12083 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582846.396448:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8c36680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186241664:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582846.396598:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da581254000 going to sleep for 11 seconds 00000100:00100000:0.0:1787582846.402239:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8c36680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186241664:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582846.402273:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582846.408903:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582846.411744:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162130176 00000100:00100000:2.0:1787582846.411758:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162130176 00010000:00010000:2.0:1787582846.411808:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75388fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58287 expref: 29 pid: 12083 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582846.411853:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 75 00000100:00100000:2.0:1787582846.411863:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5331f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+29:2360:x1874416162130176:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582846.411877:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582846.411884:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75388fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58287 expref: 29 pid: 12083 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.411916:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75388fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58287 expref: 29 pid: 12083 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.411944:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b75388fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58287 expref: 29 pid: 12083 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.411962:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acc800) 00010000:00010000:2.0:1787582846.411967:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.411976:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.411984:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.412020:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582846.412083:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5331f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+28:2360:x1874416162130176:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 221us (3188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582846.412090:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 75 00010000:00010000:1.0:1787582846.413018:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.413029:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582846.413050:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787582846.413212:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538910 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5828e expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.413241:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5828e expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.413250:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acc800) 00010000:00010000:1.0:1787582846.413253:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787582846.413256:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20eee00, rc 0) 00000100:00100000:1.0:1787582846.413409:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+28:11069:x1874416162130048:12345-192.168.206.20@tcp:101:bash.0 Request processed in 17271us (17448us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787582846.413418:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 191 00010000:00010000:1.0:1787582846.416498:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582846.424861:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582846.424998:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162130432 00000100:00100000:0.0:1787582846.425011:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162130432 00000100:00100000:0.0:1787582846.425089:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 192 00000100:00100000:0.0:1787582846.425102:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+28:11069:x1874416162130432:12345-192.168.206.20@tcp:36:bash.0 00010000:00010000:0.0:1787582846.425657:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538925 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.425679:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.425692:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787582846.425752:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:0.0:1787582846.425780:0:5854:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b307160d reply state 00000000ec13cf2c transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582846.425790:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787582846.425839:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:0.0:1787582846.425958:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+32:11069:x1874416162130432:12345-192.168.206.20@tcp:36:bash.0 Request processed in 857us (1109us total) trans 4294967475 rc 0/0 00000100:00100000:0.0:1787582846.425966:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 192 00000020:00080000:0.0:1787582846.425972:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787582846.428825:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.428844:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538925 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.428853:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538925 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.428859:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582846.428864:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538925 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.428872:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538925 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.428889:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acc800) 00010000:00010000:3.0:1787582846.428893:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582846.428898:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538925 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.428916:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538925 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582846.431843:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582846.431990:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162130560 00000100:00100000:0.0:1787582846.431999:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162130560 00000100:00100000:0.0:1787582846.432067:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 193 00000100:00100000:0.0:1787582846.432078:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+31:11069:x1874416162130560:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:0.0:1787582846.432174:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582846.432192:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753892c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58295 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.432246:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753892c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58295 expref: 32 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.432260:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753892c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58295 expref: 32 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.432278:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acc800) 00010000:00010000:0.0:1787582846.432281:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787582846.432285:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20efe00, rc 0) 00000100:00100000:0.0:1787582846.432420:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+32:11069:x1874416162130560:12345-192.168.206.20@tcp:101:bash.0 Request processed in 343us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582846.432428:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 193 00000100:00100000:0.0:1787582846.437586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582846.437706:0:12082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162130688 00000100:00100000:3.0:1787582846.437716:0:12082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162130688 00000100:00100000:3.0:1787582846.437789:0:12082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 59 00000100:00100000:3.0:1787582846.437800:0:12082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:11069:x1874416162130688:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:3.0:1787582846.437817:0:12082:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582846.437836:0:12082:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a70d5482/0xa113d808b7538933 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5829c expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787582846.437859:0:12082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c597c, atime: 0x6a8c597a, ctime: 0x6a8c597c, blocks: 0xb 00010000:00010000:3.0:1787582846.437877:0:12082:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=387s v=(0 0) 00010000:00010000:3.0:1787582846.437881:0:12082:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582846.437888:0:12082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a70d5482/0xa113d808b7538933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5829c expref: 8 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.437902:0:12082:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a70d5482/0xa113d808b7538933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5829c expref: 8 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.437913:0:12082:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1800, rc 0) 00000100:00100000:3.0:1787582846.437972:0:12082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:11069:x1874416162130688:12345-192.168.206.20@tcp:101:bash.0 Request processed in 174us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582846.437978:0:12082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 59 00000100:00080000:0.0:1787582846.438033:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787582846.441421:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582846.441504:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162130816 00000100:00100000:0.0:1787582846.441513:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162130816 00002000:00010000:0.0:1787582846.441560:0:6709:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787582846.441565:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5855c1500 with x1874416162130816 ext(0->18446744073709551615) 00002000:00010000:0.0:1787582846.441576:0:6709:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da5855c1500. 00000100:00100000:0.0:1787582846.441609:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 5 00000100:00100000:0.0:1787582846.441619:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2360:x1874416162130816:12345-192.168.206.20@tcp:10:bash.0 00002000:00010000:0.0:1787582846.442019:0:6709:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787582846.442023:0:6709:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787582844 -> 1787582846 00002000:00010000:0.0:1787582846.442026:0:6709:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787582842 -> 1787582842 00002000:00010000:0.0:1787582846.442028:0:6709:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787582844 -> 1787582846 00002000:00010000:0.0:1787582846.442030:0:6709:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787582846.442093:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:2360:x1874416162130816:12345-192.168.206.20@tcp:10:bash.0 Request processed in 475us (679us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787582846.442102:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 5 00002000:00010000:0.0:1787582846.442105:0:6709:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1787582846.442107:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5855c1500 with x1874416162130816 ext(0->18446744073709551615) 00002000:00010000:0.0:1787582846.442112:0:6709:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da5855c1500. 00000100:00100000:3.0:1787582846.550109:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186241792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787582846.550196:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582846.550591:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186241792 00000100:00100000:0.0:1787582846.550600:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186241792 00000100:00100000:0.0:1787582846.550644:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787582846.550652:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874416186241792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787582846.550685:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582846.550737:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874416186241792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582846.550744:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787582846.552417:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186241792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582846.591853:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582846.592021:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162130944 00000100:00100000:1.0:1787582846.592030:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162130944 00000100:00100000:1.0:1787582846.592089:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 194 00000100:00100000:1.0:1787582846.592098:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+32:11549:x1874416162130944:12345-192.168.206.20@tcp:34:lfs.0 00010000:00010000:1.0:1787582846.592178:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753893a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.592193:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753893a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.592204:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753893a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.592426:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538941 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.592450:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.592458:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.596883:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538948 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.599407:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601409:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787582846.601476:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601490:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753893a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601497:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753893a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601503:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753893a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601508:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582846.601512:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753893a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601520:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753893a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601551:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:1.0:1787582846.601554:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582846.601559:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753893a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601566:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b753893a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601582:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538941 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601589:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538941 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601595:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601601:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582846.601604:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538941 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601610:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538941 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601617:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da58533f600) 00010000:00010000:1.0:1787582846.601619:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582846.601622:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538941 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601627:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538941 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601656:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601662:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538948 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601668:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601673:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582846.601676:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601682:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538948 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601690:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acc800) 00010000:00010000:1.0:1787582846.601693:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582846.601696:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538948 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.601700:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538948 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582846.601785:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+32:11549:x1874416162130944:12345-192.168.206.20@tcp:34:lfs.0 Request processed in 9684us (9936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582846.601795:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 194 00000100:00100000:2.0:1787582846.718483:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582846.719037:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162131200 00000100:00100000:0.0:1787582846.719047:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162131200 00000100:00100000:0.0:1787582846.719102:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 195 00000100:00100000:0.0:1787582846.719111:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+32:11552:x1874416162131200:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582846.719130:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582846.719148:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b753894f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d582a3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719244:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538956 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719256:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719267:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719279:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753895d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719286:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753895d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719291:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753895d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719596:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719606:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719613:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582846.719622:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787582846.719698:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719706:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538956 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719718:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719724:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582846.719729:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719736:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538956 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719747:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:0.0:1787582846.719750:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582846.719754:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538956 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719760:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538956 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719772:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753895d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719778:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753895d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719784:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753895d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719790:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efa00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582846.719793:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753895d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719806:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753895d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719813:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da5a0b68500) 00010000:00010000:0.0:1787582846.719816:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582846.719818:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753895d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719824:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b753895d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719858:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b753894f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582a3 expref: 35 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719871:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582a3 expref: 34 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582846.719878:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acc800) 00010000:00010000:0.0:1787582846.719880:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787582846.719882:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580031a00, rc 0) 00000100:00100000:0.0:1787582846.719938:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+34:11552:x1874416162131200:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 827us (1462us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1787582846.719945:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 195 00000100:00100000:2.0:1787582846.733671:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582846.733832:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162131328 00000100:00100000:3.0:1787582846.733841:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162131328 00000100:00100000:3.0:1787582846.733913:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 196 00000100:00100000:3.0:1787582846.733924:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+34:11552:x1874416162131328:12345-192.168.206.20@tcp:54:lfs.0 00010000:00010000:3.0:1787582846.733987:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538972 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.734004:0:12083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5828e expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.734013:0:12083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538972 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.734046:0:12083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5828e expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.734061:0:12083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5828e expref: 34 pid: 5852 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582846.734074:0:12083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf286d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12083:1874416186241920:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582846.734197:0:12083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fd0300 going to sleep for 11 seconds 00000100:00100000:3.0:1787582846.741691:0:12083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf286d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12083:1874416186241920:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582846.741717:0:12083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538972 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582846.741968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582846.742052:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162131584 00000100:00100000:3.0:1787582846.742059:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162131584 00000100:00100000:3.0:1787582846.742120:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 52 00000100:00100000:3.0:1787582846.742144:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+35:5596:x1874416162131584:12345-192.168.206.20@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787582846.742568:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+36:5596:x1874416162131584:12345-192.168.206.20@tcp:35:ldlm_bl.0 Request processed in 424us (599us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787582846.742576:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 52 00000100:00100000:2.0:1787582846.752820:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582846.753220:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162131712 00000100:00100000:0.0:1787582846.753229:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162131712 00010000:00010000:0.0:1787582846.753267:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5828e expref: 36 pid: 5852 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582846.753352:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 76 00000100:00100000:2.0:1787582846.753365:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+36:2359:x1874416162131712:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582846.753386:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582846.753394:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5828e expref: 36 pid: 5852 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.753499:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5828e expref: 36 pid: 5852 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.753521:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538917 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5828e expref: 36 pid: 5852 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.753538:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acc800) 00010000:00010000:2.0:1787582846.753542:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538972 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.753552:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.753560:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538972 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.753595:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582846.753652:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+35:2359:x1874416162131712:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 291us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582846.753660:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 76 00010000:00010000:3.0:1787582846.753671:0:12083:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.753682:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.753712:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.753720:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538972 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.753727:0:12083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538972 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.753732:0:12083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582846.753737:0:12083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538972 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.753744:0:12083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538972 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.753754:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acc800) 00010000:00010000:3.0:1787582846.753757:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787582846.753760:0:12083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538972 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.753776:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538972 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582846.753814:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+34:11552:x1874416162131328:12345-192.168.206.20@tcp:54:lfs.0 Request processed in 19891us (20151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582846.753822:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 196 00000100:00100000:2.0:1787582846.759550:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582846.759961:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162131968 00000100:00100000:3.0:1787582846.759971:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162131968 00000100:00100000:3.0:1787582846.760032:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 53 00000100:00100000:3.0:1787582846.760042:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+34:11552:x1874416162131968:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:3.0:1787582846.760297:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+35:11552:x1874416162131968:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 256us (754us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787582846.760305:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 53 00000100:00100000:0.0:1787582846.886613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582846.886953:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162132224 00000100:00100000:1.0:1787582846.886962:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162132224 00000100:00100000:1.0:1787582846.887030:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 197 00000100:00100000:1.0:1787582846.887254:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+35:11563:x1874416162132224:12345-192.168.206.20@tcp:101:cat.0 00010000:00010000:1.0:1787582846.887275:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582846.887294:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538979 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d582aa expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887397:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538980 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887411:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538980 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887422:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538980 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887437:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538987 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887444:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887451:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887765:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753898e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887775:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753898e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887783:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753898e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582846.887804:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787582846.887895:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538980 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887903:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538980 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887909:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538980 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887915:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582846.887919:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538980 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887927:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538980 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887940:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:1.0:1787582846.887943:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582846.887947:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538980 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887953:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538980 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887965:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887971:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538987 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887987:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.887993:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582846.887995:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.888002:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538987 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.888010:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da58533f600) 00010000:00010000:1.0:1787582846.888012:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582846.888015:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538987 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.888021:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538987 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.890295:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538979 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582aa expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.890341:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753898e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582aa expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.890350:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acc800) 00010000:00010000:1.0:1787582846.890353:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582846.890357:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7c00, rc 0) 00000100:00100000:1.0:1787582846.890497:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+37:11563:x1874416162132224:12345-192.168.206.20@tcp:101:cat.0 Request processed in 3246us (3889us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1787582846.890584:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 197 00000100:00100000:2.0:1787582846.896525:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582846.896617:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162132480 00000100:00100000:0.0:1787582846.896626:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162132480 00000100:00100000:0.0:1787582846.896678:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 54 00000100:00100000:0.0:1787582846.896687:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+37:11563:x1874416162132480:12345-192.168.206.20@tcp:35:cat.0 00000100:00100000:0.0:1787582846.896893:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+38:11563:x1874416162132480:12345-192.168.206.20@tcp:35:cat.0 Request processed in 208us (376us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1787582846.896900:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 54 00000100:00100000:2.0:1787582846.957142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582846.957480:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162132736 00000100:00100000:3.0:1787582846.957490:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162132736 00000100:00100000:3.0:1787582846.957549:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 198 00000100:00100000:3.0:1787582846.957560:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+38:11564:x1874416162132736:12345-192.168.206.20@tcp:36:rm.0 00010000:00010000:3.0:1787582846.957628:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787582846.957658:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b753898e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582aa expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.957683:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538964 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582a3 expref: 37 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.957697:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b753892c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58295 expref: 36 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.957729:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acc800) 00010000:00010000:3.0:1787582846.957741:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787582846.957764:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b753899c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.957777:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b753899c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.957787:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b753899c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.957802:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75389a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.957810:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75389a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.957817:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75389a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.958168:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75389aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.958178:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75389aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.958185:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75389aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787582846.961296:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1787582846.961356:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 387968037213ns, next at 388968032746ns, rc = 0 00010000:00010000:2.0:1787582846.961454:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b75389b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961471:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b75389b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961483:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b75389b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961494:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b75389b1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961501:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b75389b1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961507:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b75389b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961530:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787582846.961555:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75389aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961562:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75389aa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961568:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75389aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961574:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582846.961578:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75389aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961597:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75389aa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961617:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acc600) 00010000:00010000:2.0:1787582846.961620:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787582846.961624:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75389aa lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961630:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1600/0xa113d808b75389aa lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961650:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b753899c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961655:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b753899c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961661:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b753899c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961666:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582846.961670:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b753899c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961676:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b753899c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961683:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:2.0:1787582846.961685:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582846.961688:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b753899c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582846.961693:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b753899c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787582846.961713:0:5855:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b5e61eb reply state 0000000014f85095 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75389a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582846.961723:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787582846.961831:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+37:11564:x1874416162132736:12345-192.168.206.20@tcp:36:rm.0 Request processed in 4269us (4693us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787582846.961840:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 198 00010000:00010000:3.0:1787582846.962713:0:11179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582846.962722:0:11179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b75389b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.962737:0:11179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9ee00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582846.962742:0:11179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b75389b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.962748:0:11179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b75389b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.962760:0:11179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8da583acc600) 00010000:00010000:3.0:1787582846.962762:0:11179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787582846.962766:0:11179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b75389b1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.962772:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ee00/0xa113d808b75389b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582846.962788:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582846.962790:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582846.962792:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582846.969026:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75389a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.969044:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75389a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.969050:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75389a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.969056:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582846.969060:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75389a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.969067:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75389a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.969082:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da583acc900) 00010000:00010000:1.0:1787582846.969085:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582846.969089:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75389a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582846.969095:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b75389a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582847.092190:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582847.092417:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162132992 00000100:00100000:3.0:1787582847.092428:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162132992 00000100:00100000:3.0:1787582847.092502:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 199 00000100:00100000:3.0:1787582847.092512:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+36:11570:x1874416162132992:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:3.0:1787582847.092533:0:12083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582847.092553:0:12083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75389b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d582b1 expref: -99 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.092681:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75389bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.092705:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75389bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.092728:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75389bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.092743:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75389c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.092750:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75389c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.092756:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75389c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787582847.093278:0:12083:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787582847.093472:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75389cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.093482:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75389cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.093489:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75389cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.093518:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75389bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.093525:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75389bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.093531:0:12083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75389bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.093543:0:12083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582847.093547:0:12083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75389bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.093554:0:12083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75389bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.093566:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:3.0:1787582847.093569:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582847.093574:0:12083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75389bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.093580:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0e00/0xa113d808b75389bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787582847.093593:0:12083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f7c0428e reply state 00000000ecd6a8e2 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75389c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582847.093602:0:12083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787582847.093633:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75389b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b1 expref: 39 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.093646:0:12083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75389cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b1 expref: 38 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.093653:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da583acc800) 00010000:00010000:3.0:1787582847.093655:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787582847.093658:0:12083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1000, rc 0) 00000100:00100000:3.0:1787582847.093727:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+39:11570:x1874416162132992:12345-192.168.206.20@tcp:101:bash.0 Request processed in 1216us (1567us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787582847.093741:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 199 00000100:00080000:0.0:1787582847.094024:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787582847.097466:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75389c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.097484:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75389c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.097492:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75389c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.097498:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582847.097503:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75389c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.097511:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75389c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.097527:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da583acc600) 00010000:00010000:3.0:1787582847.097530:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787582847.097535:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75389c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.097541:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b75389c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582847.108855:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582847.109223:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162133120 00000100:00100000:3.0:1787582847.109234:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162133120 00000100:00100000:3.0:1787582847.109310:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 60 00000100:00100000:3.0:1787582847.109349:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2357:x1874416162133120:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:3.0:1787582847.109366:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582847.109400:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090fefa00/0xa113d808b75389db lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d582b8 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787582847.109427:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787582847.109447:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=388s v=(0 0) 00010000:00010000:3.0:1787582847.109451:0:6704:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582847.109461:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090fefa00/0xa113d808b75389db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b8 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.109492:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000090fefa00/0xa113d808b75389db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b8 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.109506:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1c00, rc 0) 00000100:00100000:3.0:1787582847.109560:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2357:x1874416162133120:12345-192.168.206.20@tcp:101:bash.0 Request processed in 241us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582847.109567:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 60 00000100:00080000:0.0:1787582847.110829:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787582847.118738:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582847.119453:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162133248 00000100:00100000:0.0:1787582847.119464:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162133248 00000100:00100000:0.0:1787582847.119718:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 61 00000100:00100000:0.0:1787582847.119728:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:11570:x1874416162133248:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:0.0:1787582847.119745:0:8218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582847.119761:0:8218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d582bf expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.119799:0:8218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090fefa00/0xa113d808b75389db lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b8 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.119808:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582847.119812:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582847.119818:0:8218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 7 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.119866:0:8218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090fefa00/0xa113d808b75389db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b8 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.119880:0:8218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090fefa00/0xa113d808b75389db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b8 expref: 7 pid: 6704 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582847.119894:0:8218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5a8c34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8218:1874416186242048:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582847.119995:0:8218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da581254480 going to sleep for 11 seconds 00000100:00100000:2.0:1787582847.137944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582847.138411:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162133376 00000100:00100000:1.0:1787582847.138422:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162133376 00010000:00010000:1.0:1787582847.138462:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000090fefa00/0xa113d808b75389db lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b8 expref: 8 pid: 6704 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582847.138544:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 77 00000100:00100000:1.0:1787582847.138555:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588497100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2359:x1874416162133376:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582847.138570:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582847.138590:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000090fefa00/0xa113d808b75389db lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b8 expref: 8 pid: 6704 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.138605:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000090fefa00/0xa113d808b75389db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b8 expref: 8 pid: 6704 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.138632:0:5838:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582847.138637:0:5838:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582847.138645:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 8 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.138655:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 8 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.138688:0:5838:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 8 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582847.138701:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b5331f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5838:1874416186242176:192.168.206.20@tcp:105: 00010000:00010000:0.0:1787582847.138958:0:8218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090fefa00/0xa113d808b75389db lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b8 expref: 8 pid: 6704 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582847.138974:0:8218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5a8c34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8218:1874416186242048:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582847.138999:0:8218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 7 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.139008:0:8218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580031400, rc 0) 00000100:00100000:1.0:1787582847.140234:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5892bca80 going to sleep for 11 seconds 00000100:00100000:0.0:1787582847.146051:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:11570:x1874416162133248:12345-192.168.206.20@tcp:101:bash.0 Request processed in 26302us (27300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582847.146064:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 61 00000100:00100000:1.0:1787582847.159383:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b5331f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5838:1874416186242176:192.168.206.20@tcp:105: 00010000:00010000:1.0:1787582847.159428:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582847.159483:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588497100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162133376:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 20929us (21549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582847.159493:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 77 00000100:00100000:2.0:1787582847.162667:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582847.162772:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162133632 00000100:00100000:0.0:1787582847.162783:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162133632 00000100:00100000:0.0:1787582847.162848:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 55 00000100:00100000:0.0:1787582847.162859:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+38:11570:x1874416162133632:12345-192.168.206.20@tcp:35:bash.0 00000100:00100000:0.0:1787582847.163240:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+39:11570:x1874416162133632:12345-192.168.206.20@tcp:35:bash.0 Request processed in 382us (581us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1787582847.163248:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 55 00010000:00010000:3.0:1787582847.440512:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582847.486840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582847.486947:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162133760 00000100:00100000:1.0:1787582847.486965:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162133760 00000100:00100000:1.0:1787582847.487032:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 200 00000100:00100000:1.0:1787582847.487042:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+39:11586:x1874416162133760:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:1.0:1787582847.487065:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582847.487084:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b75389e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d582c6 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.487172:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75389f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.487185:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75389f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.487196:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75389f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582847.487254:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787582847.487258:0:5852:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582847.487281:0:5852:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75389f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.487307:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b75389e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582c6 expref: 41 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.487364:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75389f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582c6 expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.487387:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:1.0:1787582847.487390:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787582847.487394:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6a00, rc 0) 00000100:00100000:1.0:1787582847.487455:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+40:11586:x1874416162133760:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 414us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582847.487462:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 200 00000100:00100000:3.0:1787582847.504669:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582847.505082:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162134016 00000100:00100000:2.0:1787582847.505091:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162134016 00000100:00100000:2.0:1787582847.505166:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 201 00000100:00100000:2.0:1787582847.505176:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+40:11586:x1874416162134016:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582847.505194:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582847.505213:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75389f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d582cd expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.505308:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75389fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.505352:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75389fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.505364:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75389fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582847.505389:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787582847.505506:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75389f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582cd expref: 43 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.505523:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75389fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582cd expref: 42 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.505532:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da583acc800) 00010000:00010000:2.0:1787582847.505535:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787582847.505538:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9f000, rc 0) 00000100:00100000:2.0:1787582847.505602:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+42:11586:x1874416162134016:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 428us (940us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787582847.505610:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 201 00000100:00100000:2.0:1787582847.510537:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582847.510630:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582847.510922:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162134144 00000100:00100000:3.0:1787582847.510933:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162134144 00000100:00100000:3.0:1787582847.511001:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:3.0:1787582847.511011:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+42:2358:x1874416162134144:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582847.511025:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582847.511049:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b75389fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582cd expref: 42 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.511068:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da583acc800) 00010000:00010000:3.0:1787582847.511085:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582847.511148:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+41:2358:x1874416162134144:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 138us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582847.511166:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:1.0:1787582847.511514:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162134400 00000100:00100000:1.0:1787582847.511519:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162134400 00000100:00100000:1.0:1787582847.511560:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 202 00000100:00100000:1.0:1787582847.511568:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+41:11586:x1874416162134400:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:1.0:1787582847.511588:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582847.511603:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538a0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d582d4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.511689:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538a13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.511702:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538a13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.511712:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538a13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582847.511723:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787582847.511834:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538a0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582d4 expref: 44 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.511864:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538a13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582d4 expref: 43 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.511873:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da583acc800) 00010000:00010000:1.0:1787582847.511875:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787582847.511878:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6e00, rc 0) 00000100:00100000:1.0:1787582847.511913:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+43:11586:x1874416162134400:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 346us (1282us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1787582847.511920:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 202 00000100:00100000:2.0:1787582847.525556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582847.525632:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162134528 00000100:00100000:1.0:1787582847.525642:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162134528 00000100:00100000:1.0:1787582847.525696:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 62 00000100:00100000:1.0:1787582847.525705:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+6:2359:x1874416162134528:12345-192.168.206.20@tcp:1:lfs.0 00010000:00010000:1.0:1787582847.525746:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c23b5c1/0xa113d808b7538a21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.525768:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 6 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.525777:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582847.525782:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787582847.525787:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c23b5c1/0xa113d808b7538a21 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.525820:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 6 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.525848:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 6 pid: 8218 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582847.525863:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b5331f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1874416186242304:192.168.206.20@tcp:104: 00000100:00100000:1.0:1787582847.525952:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5892bca80 going to sleep for 11 seconds 00000100:00100000:3.0:1787582847.530771:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582847.531279:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162134656 00000100:00100000:0.0:1787582847.531290:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162134656 00002000:00100000:0.0:1787582847.531364:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8da5bf285f80 x1874416162134656/t0(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:313/0 lens 504/0 e 0 to 0 dl 1787582858 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787582847.531376:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5bf285f80 with x1874416162134656 ext(0->8) 00010000:00010000:0.0:1787582847.531386:0:6708:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 7 pid: 8218 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.531404:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 7 pid: 8218 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787582847.531412:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8da5bf285f80 00000100:00100000:0.0:1787582847.531444:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 3 00000100:00100000:0.0:1787582847.531453:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2360:x1874416162134656:12345-192.168.206.20@tcp:4:lfs.0 00000100:00100000:0.0:1787582847.531875:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf285f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:2360:x1874416162134656:12345-192.168.206.20@tcp:4:lfs.0 Request processed in 422us (1111us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787582847.531883:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 3 00002000:00100000:0.0:1787582847.531890:0:6708:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8da5bf285f80 x1874416162134656/t4294967308(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:313/0 lens 504/448 e 0 to 0 dl 1787582858 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787582847.532019:0:6708:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5bf285f80 with x1874416162134656 ext(0->8) 00010000:00010000:0.0:1787582847.532027:0:6708:0:(ldlm_extent.c:800:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 9 pid: 8218 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.532046:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 9 pid: 8218 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787582847.532054:0:6708:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8da5bf285f80 00000100:00100000:1.0:1787582847.532752:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b5331f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1874416186242304:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582847.532775:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008c23b5c1/0xa113d808b7538a21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582847.535165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582847.540070:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162134784 00000100:00100000:3.0:1787582847.540085:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162134784 00010000:00010000:3.0:1787582847.540476:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 9 pid: 8218 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582847.540570:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 78 00000100:00100000:3.0:1787582847.540580:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:2357:x1874416162134784:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582847.540595:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787582847.540613:0:5840:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787582847.540616:0:5840:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787582847 00002000:00010000:3.0:1787582847.540619:0:5840:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787582848 00002000:00010000:3.0:1787582847.540621:0:5840:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787582847 00010000:00010000:3.0:1787582847.540628:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 9 pid: 8218 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.540643:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 9 pid: 8218 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.540666:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebc2adbf/0xa113d808b75389e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582bf expref: 9 pid: 8218 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.540682:0:5840:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787582847.540699:0:5840:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787582847.540705:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c23b5c1/0xa113d808b7538a21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.540715:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c23b5c1/0xa113d808b7538a21 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.540756:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582847.540817:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2357:x1874416162134784:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 237us (5668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582847.540824:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 78 00010000:00010000:2.0:1787582847.540887:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008c23b5c1/0xa113d808b7538a21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.540907:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c23b5c1/0xa113d808b7538a21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.540931:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c23b5c1/0xa113d808b7538a21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.540940:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c23b5c1/0xa113d808b7538a21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.540956:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c23b5c1/0xa113d808b7538a21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.540963:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6600 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582847.540967:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c23b5c1/0xa113d808b7538a21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.540975:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c23b5c1/0xa113d808b7538a21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.540987:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c23b5c1/0xa113d808b7538a21 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.540994:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c23b5c1/0xa113d808b7538a21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582847.541039:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2359:x1874416162134528:12345-192.168.206.20@tcp:1:lfs.0 Request processed in 15335us (15491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582847.541047:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 62 00000100:00100000:2.0:1787582847.548511:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582847.548722:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162135040 00000100:00100000:3.0:1787582847.548733:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162135040 00000100:00100000:3.0:1787582847.548784:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 56 00000100:00100000:3.0:1787582847.548794:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583664c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+43:11586:x1874416162135040:12345-192.168.206.20@tcp:35:lfs.0 00000004:00010000:3.0:1787582847.548853:0:5856:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538a13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582d4 expref: 43 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787582847.549407:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787582847.549459:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787582847.549877:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787582847.550078:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538a28 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.550206:0:5856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75389cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b1 expref: 47 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.550219:0:5856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538a28 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.550263:0:5856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75389cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b1 expref: 47 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582847.550280:0:5856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75389cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b1 expref: 47 pid: 12083 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582847.550295:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf284e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5856:1874416186242432:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582847.550672:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c540 going to sleep for 11 seconds 00000100:00100000:0.0:1787582847.559579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582847.559692:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162135168 00000100:00100000:1.0:1787582847.559701:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162135168 00010000:00010000:1.0:1787582847.559737:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75389cd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b1 expref: 48 pid: 12083 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582847.559778:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 79 00000100:00100000:1.0:1787582847.559788:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+48:2360:x1874416162135168:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582847.559805:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582847.559812:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75389cd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b1 expref: 48 pid: 12083 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.559826:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75389cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b1 expref: 48 pid: 12083 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.559847:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da583acc800) 00010000:00010000:1.0:1787582847.559866:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538a28 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.559876:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538a28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.559884:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538a28 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.560019:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582847.560073:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+48:2360:x1874416162135168:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 286us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582847.560081:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 79 00010000:00010000:3.0:1787582847.561754:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b75389cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582b1 expref: 47 pid: 12083 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582847.561775:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf284e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5856:1874416186242432:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582847.561796:0:5856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538a28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.561959:0:5856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538a28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.561967:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538a28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787582847.562255:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787582847.562587:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787582847.562688:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf78000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5856:1874416186242560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787582847.562745:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582847.562826:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf3283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582847.562867:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186242560 00000100:00100000:1.0:1787582847.562873:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186242560 00000100:00100000:1.0:1787582847.562979:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787582847.562988:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5856:x1874416186242560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787582847.563473:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5856:x1874416186242560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 484us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582847.563480:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787582847.563563:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf78000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5856:1874416186242560:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1787582847.563986:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1787582847.564466:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787582847.564540:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf879180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5856:1874416186242688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787582847.564584:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582847.564648:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf328780 going to sleep for 11 seconds 00000100:00100000:3.0:1787582847.564688:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186242688 00000100:00100000:3.0:1787582847.564694:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186242688 00000100:00100000:3.0:1787582847.564781:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787582847.564790:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5856:x1874416186242688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787582847.564956:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf87aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5856:x1874416186242688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 166us (371us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787582847.564963:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787582847.565021:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf879180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5856:1874416186242688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787582847.565067:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1787582847.565115:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538a28 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.565136:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538a28 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.565145:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538a28 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.565151:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582847.565166:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538a28 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.565174:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538a28 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.565202:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da583acc800) 00010000:00010000:2.0:1787582847.565205:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787582847.565210:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538a28 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.565217:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7538a28 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787582847.565406:0:5856:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787582847.565504:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1787582847.565515:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 388572196442ns, next at 389572194412ns, rc = 0 00000001:00080000:2.0:1787582847.565521:0:5856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787582847.565552:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da583acc800) 00010000:00010000:2.0:1787582847.565556:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787582847.565563:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538a13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582d4 expref: 51 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582847.565660:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583664c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+50:11586:x1874416162135040:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 16868us (17157us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1787582847.565668:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 56 00000020:00080000:2.0:1787582847.565672:0:5856:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787582847.569286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582847.569751:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162135296 00000100:00100000:3.0:1787582847.569761:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162135296 00000100:00100000:2.0:1787582847.569920:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 203 00000100:00100000:2.0:1787582847.569932:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+50:11586:x1874416162135296:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582847.569954:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582847.569975:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538a2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d582db expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.570048:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538a2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582db expref: 51 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.570063:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538a2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582db expref: 51 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.570082:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:2.0:1787582847.570085:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787582847.570089:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9e200, rc 0) 00000100:00100000:2.0:1787582847.570267:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+51:11586:x1874416162135296:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 336us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582847.570274:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 203 00000100:00100000:0.0:1787582847.574688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582847.574846:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162135552 00000100:00100000:2.0:1787582847.574856:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162135552 00000100:00100000:2.0:1787582847.574913:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 57 00000100:00100000:2.0:1787582847.574923:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+51:11586:x1874416162135552:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:2.0:1787582847.575314:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+52:11586:x1874416162135552:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 391us (633us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787582847.575348:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 57 00000100:00100000:3.0:1787582847.718099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582847.718388:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162135680 00000100:00100000:0.0:1787582847.718397:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162135680 00000100:00100000:0.0:1787582847.718454:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 204 00000100:00100000:0.0:1787582847.718464:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+52:11596:x1874416162135680:12345-192.168.206.20@tcp:34:lfs.0 00010000:00010000:0.0:1787582847.718545:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718561:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718572:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718585:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718592:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718612:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718708:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7538a44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718716:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7538a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718723:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7538a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787582847.718763:0:12083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7538a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718775:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718781:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718788:0:12083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718793:0:12083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580030e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582847.718798:0:12083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718804:0:12083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718815:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:0.0:1787582847.718824:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582847.718830:0:12083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718835:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718849:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718855:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718861:0:12083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718866:0:12083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580031a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582847.718869:0:12083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718875:0:12083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718882:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da5a0b68500) 00010000:00010000:0.0:1787582847.718885:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582847.718887:0:12083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718892:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718906:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7538a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718918:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7538a44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718924:0:12083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7538a44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718929:0:12083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580031e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582847.718932:0:12083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7538a44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718937:0:12083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7538a44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718944:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:0.0:1787582847.718947:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582847.718950:0:12083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7538a44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.718955:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7538a44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582847.719031:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+52:11596:x1874416162135680:12345-192.168.206.20@tcp:34:lfs.0 Request processed in 567us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582847.719039:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 204 00000100:00100000:3.0:1787582847.832950:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582847.833569:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162135936 00000100:00100000:0.0:1787582847.833581:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162135936 00000100:00100000:0.0:1787582847.833647:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 205 00000100:00100000:0.0:1787582847.833657:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+52:11599:x1874416162135936:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582847.833677:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582847.833704:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7538a4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d582e2 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.833774:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.833788:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.833799:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.833814:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.833821:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.833833:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.834280:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7538a60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.834290:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7538a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582847.834296:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7538a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582847.834305:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787582847.836036:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836053:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836062:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836067:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580031a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582847.836071:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836092:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836108:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:1.0:1787582847.836299:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582847.836305:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836311:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031a00/0xa113d808b7538a52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836351:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836357:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836362:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836366:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580030e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582847.836368:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836375:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836383:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da5a0b68500) 00010000:00010000:1.0:1787582847.836386:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582847.836388:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836405:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030e00/0xa113d808b7538a59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836462:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031e00/0xa113d808b7538a4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582e2 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836476:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7538a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582e2 expref: 54 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582847.836484:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:1.0:1787582847.836486:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582847.836489:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580031400, rc 0) 00000100:00100000:1.0:1787582847.837062:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+54:11599:x1874416162135936:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 3403us (4128us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787582847.837071:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 205 00000100:00100000:3.0:1787582847.844837:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582847.844958:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162136064 00000100:00100000:2.0:1787582847.844968:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162136064 00000100:00100000:2.0:1787582847.845024:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 206 00000100:00100000:2.0:1787582847.845033:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+54:11599:x1874416162136064:12345-192.168.206.20@tcp:54:lfs.0 00010000:00010000:2.0:1787582847.845095:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538a6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.845140:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.845163:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.845191:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.845199:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538a6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.845205:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538a6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.845211:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9e400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582847.845215:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538a6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.845222:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538a6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.845233:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:2.0:1787582847.845236:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787582847.845241:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538a6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582847.845247:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538a6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582847.845307:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+54:11599:x1874416162136064:12345-192.168.206.20@tcp:54:lfs.0 Request processed in 275us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582847.845342:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 206 00000100:00100000:3.0:1787582847.848080:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582847.848628:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162136320 00000100:00100000:2.0:1787582847.848639:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162136320 00000100:00100000:2.0:1787582847.848687:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 58 00000100:00100000:2.0:1787582847.848696:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+54:11599:x1874416162136320:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:2.0:1787582847.848924:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:11599:x1874416162136320:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 227us (850us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787582847.848932:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 58 00000100:00100000:3.0:1787582848.018831:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582848.018993:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162136576 00000100:00100000:1.0:1787582848.019003:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162136576 00000100:00100000:1.0:1787582848.019063:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 207 00000100:00100000:1.0:1787582848.019073:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+55:11609:x1874416162136576:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:1.0:1787582848.019095:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582848.019099:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787582848.019128:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b75389f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582c6 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.019149:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:1.0:1787582848.019163:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787582848.019190:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538a75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d582e9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.019293:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538a7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.019358:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.019368:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538a7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582848.019378:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787582848.019512:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538a75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582e9 expref: 57 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.019538:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538a7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582e9 expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.019547:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:1.0:1787582848.019549:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582848.019552:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6e00, rc 0) 00000100:00100000:1.0:1787582848.019610:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:11609:x1874416162136576:12345-192.168.206.20@tcp:101:bash.0 Request processed in 539us (788us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787582848.019617:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 207 00000100:00100000:3.0:1787582848.029801:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582848.029996:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162136832 00000100:00100000:1.0:1787582848.030012:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162136832 00000100:00100000:1.0:1787582848.030082:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 208 00000100:00100000:1.0:1787582848.030093:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:11609:x1874416162136832:12345-192.168.206.20@tcp:36:bash.0 00010000:00010000:1.0:1787582848.030182:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787582848.030208:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538a7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582e9 expref: 56 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.030231:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580031400/0xa113d808b7538a60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582e2 expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.030243:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:1.0:1787582848.030247:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787582848.030495:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538a8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.030509:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538a8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.030519:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538a8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787582848.030585:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1787582848.030612:0:5852:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b105ee61 reply state 0000000038980b4f transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538a8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582848.030621:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787582848.030716:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:11609:x1874416162136832:12345-192.168.206.20@tcp:36:bash.0 Request processed in 624us (926us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787582848.030723:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 208 00000020:00080000:1.0:1787582848.030729:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787582848.038515:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538a8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.038569:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538a8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.038576:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538a8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.038583:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582848.038587:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538a8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.038594:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538a8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.038624:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:1.0:1787582848.038626:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582848.038631:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538a8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.038636:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538a8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582848.042983:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582848.043085:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162136960 00000100:00100000:0.0:1787582848.043100:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162136960 00000100:00100000:0.0:1787582848.043191:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 209 00000100:00100000:0.0:1787582848.043202:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+56:11609:x1874416162136960:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:0.0:1787582848.043225:0:12083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582848.043243:0:12083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538a91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d582f0 expref: -99 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.043359:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538a98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.043372:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.043383:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582848.043409:0:12083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787582848.043413:0:12083:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582848.044101:0:12083:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.044136:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538a91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582f0 expref: 58 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.044164:0:12083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582f0 expref: 57 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.044172:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:0.0:1787582848.044175:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582848.044178:0:12083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ee400, rc 0) 00000100:00100000:0.0:1787582848.044307:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483511880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:11609:x1874416162136960:12345-192.168.206.20@tcp:101:bash.0 Request processed in 1106us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582848.044362:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 209 00000100:00100000:3.0:1787582848.054453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582848.054684:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162137216 00000100:00100000:2.0:1787582848.054694:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162137216 00000100:00100000:2.0:1787582848.054746:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 59 00000100:00100000:2.0:1787582848.054757:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da483511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+57:11609:x1874416162137216:12345-192.168.206.20@tcp:35:bash.0 00000100:00100000:2.0:1787582848.054986:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da483511f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+58:11609:x1874416162137216:12345-192.168.206.20@tcp:35:bash.0 Request processed in 231us (540us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787582848.054994:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 59 00000100:00100000:0.0:1787582848.219478:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582848.219732:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162137344 00000100:00100000:2.0:1787582848.219741:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162137344 00000100:00100000:2.0:1787582848.219806:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 210 00000100:00100000:2.0:1787582848.219816:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5892dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+58:11615:x1874416162137344:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582848.219839:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582848.219858:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538a9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d582f7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.219932:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538aa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.219961:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.219972:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582848.220027:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787582848.220031:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787582848.220051:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.220076:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7538a9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582f7 expref: 60 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.220092:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582f7 expref: 59 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.220100:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:2.0:1787582848.220103:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787582848.220106:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9e800, rc 0) 00000100:00100000:2.0:1787582848.220406:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5892dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+59:11615:x1874416162137344:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 590us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582848.220413:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 210 00000100:00100000:3.0:1787582848.227071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582848.227254:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162137472 00000100:00100000:2.0:1787582848.227262:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162137472 00000100:00100000:2.0:1787582848.227314:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 211 00000100:00100000:2.0:1787582848.227340:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+59:11615:x1874416162137472:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582848.227358:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582848.227381:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f200/0xa113d808b7538aad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d582fe expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227435:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538ab4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227447:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227458:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227470:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538abb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227477:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227484:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227577:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227585:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227591:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582848.227619:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787582848.227623:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787582848.227638:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227653:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227661:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227668:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538ab4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227675:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227680:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9fe00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582848.227684:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227691:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538ab4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227702:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:2.0:1787582848.227705:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582848.227709:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538ab4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227715:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b7538ab4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227725:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227731:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538abb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227740:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538abb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227745:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9f000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582848.227748:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538abb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227753:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538abb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227760:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da5a4492a00) 00010000:00010000:2.0:1787582848.227762:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582848.227764:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538abb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227769:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538abb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227794:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f200/0xa113d808b7538aad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582fe expref: 61 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227805:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582fe expref: 60 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.227812:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:2.0:1787582848.227814:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787582848.227816:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9fa00, rc 0) 00000100:00100000:2.0:1787582848.227875:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:11615:x1874416162137472:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 536us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582848.227889:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 211 00000100:00100000:3.0:1787582848.232750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582848.232881:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162137728 00000100:00100000:0.0:1787582848.232890:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162137728 00000100:00100000:0.0:1787582848.232953:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 212 00000100:00100000:0.0:1787582848.232963:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:11615:x1874416162137728:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582848.232982:0:12083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582848.233000:0:12083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538ac9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58305 expref: -99 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.233091:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.233105:0:12083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538a98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582f0 expref: 61 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.233113:0:12083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582fe expref: 61 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.233120:0:12083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.233172:0:12083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582fe expref: 61 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.233185:0:12083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582fe expref: 61 pid: 7653 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582848.233215:0:12083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5892dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12083:1874416186242816:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582848.233314:0:12083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582f0 expref: 61 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.233346:0:12083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538a98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582f0 expref: 61 pid: 12083 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582848.233356:0:12083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb2b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12083:1874416186242944:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582848.233380:0:12083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da581254480 going to sleep for 11 seconds 00000100:00100000:0.0:1787582848.244642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582848.244741:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162137856 00000100:00100000:1.0:1787582848.244750:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162137856 00010000:00010000:1.0:1787582848.244801:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538ac2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582fe expref: 62 pid: 7653 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582848.244844:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 80 00000100:00100000:1.0:1787582848.244854:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+62:2357:x1874416162137856:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582848.244869:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582848.244887:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538ac2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582fe expref: 62 pid: 7653 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.244912:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582fe expref: 62 pid: 7653 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.244932:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:1.0:1787582848.244936:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.244945:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.244951:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582848.245009:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+62:2357:x1874416162137856:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 156us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582848.245017:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 80 00010000:00010000:3.0:1787582848.245627:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fa00/0xa113d808b7538ac2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582fe expref: 61 pid: 7653 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582848.245643:0:12083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5892dc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12083:1874416186242816:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582848.245655:0:12083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb2b2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12083:1874416186242944:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582848.245678:0:12083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582848.248633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582848.251090:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162137984 00000100:00100000:2.0:1787582848.251105:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162137984 00010000:00010000:2.0:1787582848.251170:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538a98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582f0 expref: 61 pid: 12083 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582848.251217:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 81 00000100:00100000:2.0:1787582848.251227:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+61:2359:x1874416162137984:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582848.251242:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582848.251249:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538a98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582f0 expref: 61 pid: 12083 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.251262:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582f0 expref: 61 pid: 12083 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.251285:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538a98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582f0 expref: 61 pid: 12083 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.251303:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:2.0:1787582848.251308:0:8463:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.251338:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.251346:0:8463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.251387:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582848.251436:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:2359:x1874416162137984:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 211us (2811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582848.251443:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 81 00010000:00010000:3.0:1787582848.251756:0:12083:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.251766:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582848.251785:0:12083:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787582848.251943:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538ac9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58305 expref: 61 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.251959:0:12083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58305 expref: 60 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.251974:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:3.0:1787582848.251976:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787582848.251978:0:12083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20eee00, rc 0) 00000100:00100000:3.0:1787582848.252005:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:11615:x1874416162137728:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 19044us (19265us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1787582848.252012:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 212 00000100:00100000:2.0:1787582848.255728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582848.255803:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162138240 00000100:00100000:1.0:1787582848.255812:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162138240 00000100:00100000:1.0:1787582848.255860:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 15 00000100:00100000:1.0:1787582848.255869:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:11615:x1874416162138240:12345-192.168.206.20@tcp:103:lfs.0 00010000:00010000:1.0:1787582848.255883:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582848.255918:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7538a2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582db expref: 60 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.255936:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:1.0:1787582848.255940:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582848.255993:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+59:11615:x1874416162138240:12345-192.168.206.20@tcp:103:lfs.0 Request processed in 125us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582848.256013:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 15 00000100:00100000:0.0:1787582848.258652:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582848.258785:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162138368 00000100:00100000:2.0:1787582848.258794:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162138368 00000100:00100000:2.0:1787582848.258834:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 213 00000100:00100000:2.0:1787582848.258842:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+59:11615:x1874416162138368:12345-192.168.206.20@tcp:58:lfs.0 00010000:00010000:2.0:1787582848.258931:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538ade lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.258946:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538ade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.258957:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538ade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787582848.259168:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787582848.259250:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+59:11615:x1874416162138368:12345-192.168.206.20@tcp:58:lfs.0 Request processed in 407us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582848.259258:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 213 00000100:00100000:3.0:1787582848.264308:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582848.264531:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162138496 00000100:00100000:1.0:1787582848.264540:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162138496 00000100:00100000:1.0:1787582848.264598:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 214 00000100:00100000:1.0:1787582848.264609:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+59:11615:x1874416162138496:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:1.0:1787582848.264628:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582848.264647:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538ae5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5830c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.264701:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538ade lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.264711:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538ae5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5830c expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.264730:0:5854:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538ade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.264744:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538ae5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5830c expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.264758:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:1.0:1787582848.264761:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787582848.264764:0:5854:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538ae5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5830c expref: 60 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.264772:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6c00, rc 0) 00000100:00100000:1.0:1787582848.264850:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:11615:x1874416162138496:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 243us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582848.264857:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 214 00010000:00010000:1.0:1787582848.464580:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787582848.784570:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787582848.784579:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787582848.784618:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787582848.784624:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787582848.784738:0:11695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf878000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11695:1874416186243072:192.168.206.20@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787582848.784871:0:11695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf328900 going to sleep for 11 seconds 00000100:00100000:2.0:1787582848.789843:0:11695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf878000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11695:1874416186243072:192.168.206.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787582848.792361:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582848.792775:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162138624 00000100:00100000:3.0:1787582848.792784:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162138624 00000100:00100000:3.0:1787582848.792883:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 215 00000100:00100000:3.0:1787582848.792893:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:11616:x1874416162138624:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787582848.792923:0:12083:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787582848.793024:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:11616:x1874416162138624:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 Request processed in 132us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582848.793031:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 215 00000100:00100000:3.0:1787582848.799439:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582848.800501:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162138752 00000100:00100000:1.0:1787582848.800513:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162138752 00000100:00100000:1.0:1787582848.800592:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 216 00000100:00100000:1.0:1787582848.800602:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:11616:x1874416162138752:12345-192.168.206.20@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787582848.800680:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538aec lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800695:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538aec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800708:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538aec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800723:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538af3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800730:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538af3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800736:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538af3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800759:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538afa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800768:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800792:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582848.800830:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787582848.800834:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582848.800846:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800855:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538aec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800860:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538aec lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800866:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538aec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800872:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582848.800876:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538aec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800882:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538aec lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800909:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8da5a0b68e00) 00010000:00010000:1.0:1787582848.800912:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582848.800917:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538aec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800923:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538aec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800947:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538af3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800953:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538af3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800959:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538af3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800964:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582848.800967:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538af3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800973:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538af3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800981:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8da58533f600) 00010000:00010000:1.0:1787582848.800983:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582848.800986:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538af3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.800992:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538af3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.801005:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.801011:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538afa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.801016:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.801027:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582848.801030:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.801036:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538afa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.801044:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:1.0:1787582848.801046:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582848.801049:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538afa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.801054:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538afa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582848.802311:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:11616:x1874416162138752:12345-192.168.206.20@tcp:34:lhsmtool_posix.0 Request processed in 1701us (2873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582848.802354:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 216 00000100:00100000:0.0:1787582848.810687:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582848.810812:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162139008 00000100:00100000:1.0:1787582848.810821:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162139008 00000100:00100000:1.0:1787582848.810882:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 217 00000100:00100000:1.0:1787582848.810902:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+60:11616:x1874416162139008:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787582848.810920:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582848.810939:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538b01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58313 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.811025:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538b08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.811059:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.811070:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582848.811082:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787582848.811194:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.811202:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538b08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.811209:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538b08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.811215:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582848.811219:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538b08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.811226:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538b08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.811238:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:1.0:1787582848.811241:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787582848.811245:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538b08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.811251:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7a00/0xa113d808b7538b08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.811289:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538b01 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58313 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.811305:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8da5a0b68e00) 00010000:00010000:1.0:1787582848.811308:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787582848.811312:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538b01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58313 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.811374:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7400, rc 0) 00000100:00100000:1.0:1787582848.811424:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+61:11616:x1874416162139008:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 533us (745us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1787582848.811430:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 217 00000100:00100000:0.0:1787582848.817112:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582848.817285:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162139136 00000100:00100000:3.0:1787582848.817296:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162139136 00000100:00100000:3.0:1787582848.817370:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 218 00000100:00100000:3.0:1787582848.817379:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+61:11616:x1874416162139136:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787582848.817419:0:12083:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787582848.817518:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5382d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+61:11616:x1874416162139136:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 Request processed in 140us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582848.817526:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 218 00000100:00100000:3.0:1787582848.823111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582848.823435:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162139392 00000100:00100000:1.0:1787582848.823447:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162139392 00000100:00100000:1.0:1787582848.823510:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 219 00000100:00100000:1.0:1787582848.823520:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+61:11616:x1874416162139392:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787582848.823539:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582848.823543:0:7653:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787582848.823569:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b7538aa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d582f7 expref: 61 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.823588:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:1.0:1787582848.823593:0:7653:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787582848.823606:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538b16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5831a expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787582848.826765:0:7653:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1787582848.827006:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538b1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.827034:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.827046:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.827119:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538b16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5831a expref: 63 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.827138:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5831a expref: 62 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.827157:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8da58533f600) 00010000:00010000:1.0:1787582848.827160:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582848.827163:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6600, rc 0) 00000100:00100000:1.0:1787582848.827222:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+62:11616:x1874416162139392:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 3703us (4119us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1787582848.827231:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 219 00000100:00100000:1.0:1787582848.838043:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582848.838143:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162139648 00000100:00100000:0.0:1787582848.838165:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162139648 00000100:00100000:0.0:1787582848.838222:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 220 00000100:00100000:0.0:1787582848.838232:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+62:11616:x1874416162139648:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787582848.838306:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582848.838389:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538b1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5831a expref: 62 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838409:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8da58533f600) 00010000:00010000:0.0:1787582848.838424:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787582848.838471:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538b2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838484:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538b2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838493:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538b2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838530:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538b32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x88a47728 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838538:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538b32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x88a47728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838544:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538b32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x88a47728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838615:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538b2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838622:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538b2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838628:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538b2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838633:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efa00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582848.838637:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538b2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838644:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538b2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838854:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:0.0:1787582848.838857:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582848.838861:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538b2b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838867:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efa00/0xa113d808b7538b2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838878:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538b32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x88a47728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838884:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538b32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x88a47728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838889:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538b32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x88a47728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838894:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582848.838896:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538b32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x88a47728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838902:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538b32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x88a47728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838908:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x88a47728 (ffff8da5a0b68300) 00010000:00010000:0.0:1787582848.838910:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582848.838913:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538b32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x88a47728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.838918:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee400/0xa113d808b7538b32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x88a47728 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582848.839049:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+61:11616:x1874416162139648:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 Request processed in 818us (1014us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787582848.839057:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 220 00000100:00100000:0.0:1787582848.842976:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582848.843065:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162139776 00000100:00100000:1.0:1787582848.843075:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162139776 00000100:00100000:1.0:1787582848.843141:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 221 00000100:00100000:1.0:1787582848.843162:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+61:11616:x1874416162139776:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787582848.843180:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582848.843203:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538b39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58321 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.843257:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538b40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.843271:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.843281:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.843403:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538b39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58321 expref: 63 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.843421:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58321 expref: 62 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.843429:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8da58533f100) 00010000:00010000:1.0:1787582848.843431:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787582848.843435:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6a00, rc 0) 00000100:00100000:1.0:1787582848.843484:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5383100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+62:11616:x1874416162139776:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 335us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582848.843491:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 221 00000100:00100000:0.0:1787582848.848493:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582848.848673:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162140032 00000100:00100000:1.0:1787582848.848684:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162140032 00000100:00100000:1.0:1787582848.848739:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 222 00000100:00100000:1.0:1787582848.848749:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+62:11616:x1874416162140032:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787582848.848829:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538b47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.848864:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538b47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.848875:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538b47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787582848.849142:0:7653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1787582848.849169:0:7653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 389855850456ns, next at 390855847881ns, rc = 0 00000004:00010000:1.0:1787582848.849258:0:7653:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006642ee22 reply state 00000000caf5e054 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538b47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582848.849268:0:7653:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787582848.849521:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5381880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+64:11616:x1874416162140032:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 Request processed in 772us (1035us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787582848.849537:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 222 00010000:00010000:3.0:1787582848.853609:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538b47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.853628:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538b47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.853636:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538b47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.853643:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582848.853648:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538b47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.853656:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538b47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.853673:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8da58533f100) 00010000:00010000:3.0:1787582848.853677:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787582848.853681:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538b47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.853688:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538b47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582848.854080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582848.854811:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162140160 00000100:00100000:3.0:1787582848.854822:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162140160 00000100:00100000:3.0:1787582848.854877:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 223 00000100:00100000:3.0:1787582848.854887:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+63:11616:x1874416162140160:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787582848.854921:0:12083:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582848.854939:0:12083:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538b4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58328 expref: -99 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.855007:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538b4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58328 expref: 64 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.855022:0:12083:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538b4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58328 expref: 64 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.855041:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8da58533f100) 00010000:00010000:3.0:1787582848.855044:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787582848.855048:0:12083:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1000, rc 0) 00000100:00100000:3.0:1787582848.855112:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5380000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+64:11616:x1874416162140160:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 225us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582848.855127:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 223 00000100:00100000:0.0:1787582848.858713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582848.858934:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162140288 00000100:00100000:3.0:1787582848.858943:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162140288 00000100:00100000:3.0:1787582848.859013:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 63 00000100:00100000:3.0:1787582848.859025:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58303c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:2359:x1874416162140288:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787582848.859592:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582848.859651:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58303c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:2359:x1874416162140288:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 Request processed in 627us (945us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787582848.859660:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 63 00000100:00100000:2.0:1787582848.862821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582848.862960:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162140544 00000100:00100000:3.0:1787582848.862969:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162140544 00000100:00100000:3.0:1787582848.863057:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 60 00000100:00100000:3.0:1787582848.863068:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+64:11616:x1874416162140544:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787582848.863314:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+65:11616:x1874416162140544:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 Request processed in 248us (500us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787582848.863802:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 60 00000100:00100000:2.0:1787582848.865938:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582848.866027:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162140800 00000100:00100000:1.0:1787582848.866035:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162140800 00000100:00100000:0.0:1787582848.866659:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 224 00000100:00100000:0.0:1787582848.866672:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+65:11616:x1874416162140800:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787582848.866817:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+65:11616:x1874416162140800:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 147us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582848.866826:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 224 00000100:00100000:0.0:1787582848.869918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582848.870016:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162140928 00000100:00100000:2.0:1787582848.870025:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162140928 00000100:00100000:2.0:1787582848.870079:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 225 00000100:00100000:2.0:1787582848.870089:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+65:11616:x1874416162140928:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787582848.870106:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582848.870125:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b7538b55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5832f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.870213:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538b5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.870227:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.870238:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582848.870272:0:5855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787582848.870290:0:5855:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.870350:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ea00/0xa113d808b7538b55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5832f expref: 67 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.870370:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5832f expref: 66 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.870393:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8da58533f100) 00010000:00010000:2.0:1787582848.870396:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787582848.870400:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9e600, rc 0) 00000100:00100000:2.0:1787582848.870449:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5382300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+66:11616:x1874416162140928:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 361us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582848.870456:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 225 00000100:00100000:2.0:1787582848.873105:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582848.873296:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162141056 00000100:00100000:0.0:1787582848.873305:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162141056 00000100:00100000:0.0:1787582848.873396:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 64 00000100:00100000:0.0:1787582848.873406:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+10:2357:x1874416162141056:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787582848.873422:0:8218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582848.873441:0:8218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538b63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58336 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787582848.873466:0:8218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c5981, blocks: 0x1 00010000:00010000:0.0:1787582848.873481:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=389s v=(0 0) 00010000:00010000:0.0:1787582848.873486:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582848.873507:0:8218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538b63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58336 expref: 11 pid: 8218 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.873525:0:8218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538b63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58336 expref: 11 pid: 8218 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582848.873538:0:8218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20efe00, rc 0) 00000100:00100000:0.0:1787582848.873586:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf926680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+11:2357:x1874416162141056:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 182us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582848.873593:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 64 00000100:00100000:0.0:1787582848.876424:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582848.876475:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162141312 00000100:00100000:1.0:1787582848.876484:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162141312 00000100:00100000:1.0:1787582848.876530:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 226 00000100:00100000:1.0:1787582848.876537:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+66:11616:x1874416162141312:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787582848.876631:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5383480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+66:11616:x1874416162141312:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 94us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582848.876639:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 226 00000100:00100000:1.0:1787582848.878989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582848.879072:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162141440 00000100:00100000:2.0:1787582848.879081:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162141440 00000100:00100000:2.0:1787582848.879127:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 65 00000100:00100000:2.0:1787582848.879136:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+11:11616:x1874416162141440:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787582848.879160:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582848.879177:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be7e1335/0xa113d808b7538b6a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5833d expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.879204:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538b63 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58336 expref: 12 pid: 8218 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.879213:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787582848.879217:0:6705:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787582848.879222:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be7e1335/0xa113d808b7538b6a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5833d expref: 12 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.879255:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538b63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58336 expref: 12 pid: 8218 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.879288:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538b63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58336 expref: 12 pid: 8218 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582848.879303:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf926d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1874416186243200:192.168.206.20@tcp:104: 00000100:00100000:2.0:1787582848.879411:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf328900 going to sleep for 11 seconds 00000100:00100000:0.0:1787582848.881821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582848.881926:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162141568 00000100:00100000:1.0:1787582848.881934:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162141568 00000100:00100000:2.0:1787582848.881957:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf926d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1874416186243200:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582848.881967:0:8463:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538b63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58336 expref: 13 pid: 8218 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.881985:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be7e1335/0xa113d808b7538b6a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5833d expref: 13 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.882000:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9ea00, rc 0) 00000100:00100000:1.0:1787582848.882018:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 82 00000100:00100000:1.0:1787582848.882027:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5383b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:2360:x1874416162141568:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582848.882040:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787582848.882049:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:11616:x1874416162141440:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 2915us (3071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582848.882056:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 65 00010000:00010000:1.0:1787582848.882061:0:8463:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538b63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58336 expref: 13 pid: 8218 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.882073:0:8463:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538b63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58336 expref: 12 pid: 8218 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.882094:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009554fde6/0xa113d808b7538b63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58336 expref: 12 pid: 8218 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.882108:0:8463:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582848.882113:0:8463:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582848.882120:0:8463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be7e1335/0xa113d808b7538b6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5833d expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.882130:0:8463:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be7e1335/0xa113d808b7538b6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5833d expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.882169:0:8463:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000be7e1335/0xa113d808b7538b6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5833d expref: 11 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582848.882182:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b5332300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8463:1874416186243328:192.168.206.20@tcp:105: 00000100:00100000:1.0:1787582848.882229:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787582848.888866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582848.888957:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b5332300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8463:1874416186243328:192.168.206.20@tcp:105: 00010000:00010000:1.0:1787582848.888977:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582848.889032:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5383b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+11:2360:x1874416162141568:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 7005us (7218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582848.889044:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 82 00000100:00100000:2.0:1787582848.889348:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162141696 00000100:00100000:2.0:1787582848.889356:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162141696 00002000:00100000:2.0:1787582848.889401:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8da5b5382680 x1874416162141696/t0(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:314/0 lens 504/0 e 0 to 0 dl 1787582859 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787582848.889411:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5b5382680 with x1874416162141696 ext(0->12) 00002000:00010000:2.0:1787582848.889416:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da5b5382680 00000100:00100000:2.0:1787582848.889442:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 6 00000100:00100000:2.0:1787582848.889451:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+11:2359:x1874416162141696:12345-192.168.206.20@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787582848.889904:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:2359:x1874416162141696:12345-192.168.206.20@tcp:4:lhsmtool_posix.0 Request processed in 439us (1031us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787582848.889918:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 6 00002000:00100000:2.0:1787582848.889926:0:6710:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8da5b5382680 x1874416162141696/t4294967320(0) o4->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:314/0 lens 504/448 e 0 to 0 dl 1787582859 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787582848.889935:0:6710:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5b5382680 with x1874416162141696 ext(0->12) 00002000:00010000:2.0:1787582848.889938:0:6710:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da5b5382680 00000100:00100000:0.0:1787582848.892945:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582848.893194:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162141824 00000100:00100000:2.0:1787582848.893203:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162141824 00000100:00100000:2.0:1787582848.893267:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 227 00000100:00100000:2.0:1787582848.893623:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+66:11616:x1874416162141824:12345-192.168.206.20@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787582848.952054:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967483 is committed 00000001:00080000:3.0:1787582848.952097:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1787582848.952100:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1787582848.952159:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787582848.952178:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8da5bf3283c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787582848.952183:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da5bb2a0800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8da5bf328c00 00000020:00080000:3.0:1787582848.952186:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da5bb2a0e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8da582f08400 00000004:00080000:3.0:1787582848.952201:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000001:00080000:3.0:1787582848.952207:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:3.0:1787582848.952230:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8da5b4fd0240 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787582848.952234:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da5bf2d3c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8da5b4fd03c0 00000020:00080000:3.0:1787582848.952236:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da5bf2d3b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8da5bb597c00 00000020:00080000:3.0:1787582848.952241:0:5876:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1787582848.952383:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1787582848.952875:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787582848.953011:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf1aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186243456:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787582848.953075:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582848.953171:0:12082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186243456 00000100:00100000:3.0:1787582848.953570:0:12082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186243456 00000100:00100000:3.0:1787582848.953617:0:12082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787582848.953626:0:12082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3312:x1874416186243456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787582848.953651:0:12082:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1787582848.953681:0:12082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8c597f, atime: 0x6a8c5980, ctime: 0x6a8c597f, blocks: 0x1 00010000:00010000:3.0:1787582848.953689:0:12082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a46f672d/0xa113d808b7538b71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.953715:0:12082:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=389s v=(0 0) 00010000:00010000:3.0:1787582848.953719:0:12082:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582848.953725:0:12082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a46f672d/0xa113d808b7538b71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.953740:0:12082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a46f672d/0xa113d808b7538b71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.953749:0:12082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a46f672d/0xa113d808b7538b71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.953757:0:12082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a46f672d/0xa113d808b7538b71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.953844:0:12082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787582848.954991:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b5381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186243584:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787582848.955038:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582848.955068:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582848.955074:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b5380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186243712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787582848.955093:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582848.955249:0:12082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3312:x1874416186243456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1623us (2172us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787582848.955259:0:12082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787582848.955618:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5383800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+20:11616:x1874416162141824:12345-192.168.206.20@tcp:44:lhsmtool_posix.0 Request processed in 61997us (62678us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582848.955626:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 227 00000100:00100000:3.0:1787582848.956696:0:12082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186243584 00000100:00100000:3.0:1787582848.956707:0:12082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186243584 00000100:00100000:3.0:1787582848.956752:0:12082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186243712 00000100:00100000:3.0:1787582848.956756:0:12082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186243712 00000100:00080000:2.0:1787582848.956854:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582848.957000:0:12082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787582848.957009:0:12082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3313:x1874416186243584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787582848.957034:0:12082:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1787582848.957057:0:12082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b7538b78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.957086:0:12082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a70d5482/0xa113d808b7538933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5829c expref: 12 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.957094:0:12082:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1787582848.957098:0:12082:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787582848.957103:0:12082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b7538b78 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787582848.957242:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8da5bf1aed80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787582848.957249:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf1aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186243456:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787582848.957609:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787582848.957620:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1874416186243712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787582848.958544:0:6703:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787582848.958551:0:6703:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787582849 00002000:00010000:2.0:1787582848.958554:0:6703:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787582848.958556:0:6703:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787582849 -> 1787582849 00002000:00010000:2.0:1787582848.958558:0:6703:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787582848.958638:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3313:x1874416186243712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1018us (3541us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787582848.958646:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:2.0:1787582848.958674:0:11179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582848.958690:0:11179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a46f672d/0xa113d808b7538b71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.958700:0:11179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0e00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582848.958705:0:11179:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a46f672d/0xa113d808b7538b71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.958714:0:11179:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a46f672d/0xa113d808b7538b71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.958731:0:11179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a46f672d/0xa113d808b7538b71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.958738:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a46f672d/0xa113d808b7538b71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.958755:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582848.958757:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582848.958759:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787582848.959083:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8da5b5380700/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787582848.959090:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b5380700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186243712:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1787582848.959620:0:12082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a70d5482/0xa113d808b7538933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5829c expref: 12 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582848.959639:0:12082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a70d5482/0xa113d808b7538933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5829c expref: 12 pid: 12082 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582848.959653:0:12082:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf1ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12082:1874416186243840:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582848.960057:0:12082:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787582848.961111:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582848.961229:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162141952 00000100:00100000:2.0:1787582848.961238:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162141952 00000100:00100000:2.0:1787582848.961297:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 69 00000100:00100000:2.0:1787582848.961306:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+13:2358:x1874416162141952:12345-192.168.206.20@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787582848.974777:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582848.974809:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162142080 00000100:00100000:2.0:1787582848.974817:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162142080 00010000:00010000:2.0:1787582848.974853:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a70d5482/0xa113d808b7538933 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5829c expref: 14 pid: 12082 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582848.975088:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 83 00000100:00100000:2.0:1787582848.975098:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf926d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:2360:x1874416162142080:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582848.975112:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582848.975128:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a70d5482/0xa113d808b7538933 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5829c expref: 14 pid: 12082 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.975143:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a70d5482/0xa113d808b7538933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5829c expref: 14 pid: 12082 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.975177:0:5838:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787582848.975182:0:5838:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787582848.975188:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b7538b78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.975198:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b7538b78 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.975217:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582848.975261:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf926d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+14:2360:x1874416162142080:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 164us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582848.975269:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 83 00010000:00010000:2.0:1787582848.983498:0:12082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a70d5482/0xa113d808b7538933 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5829c expref: 13 pid: 12082 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582848.983534:0:12082:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf1ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12082:1874416186243840:192.168.206.20@tcp:104: 00010000:00010000:2.0:1787582848.983556:0:12082:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b7538b78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.983567:0:12082:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b7538b78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.983574:0:12082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b7538b78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.983584:0:12082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b7538b78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.983592:0:12082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b7538b78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582848.983620:0:12082:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787582848.984027:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582848.984034:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b7538b78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.984043:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1600 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:1.0:1787582848.984048:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b7538b78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.984057:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b7538b78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.984075:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b7538b78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.984082:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005370e480/0xa113d808b7538b78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582848.984099:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582848.984101:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582848.984102:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582848.987599:0:12082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3313:x1874416186243584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30586us (32555us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787582848.987611:0:12082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1787582848.987709:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8da5b5381f80/2, rc 0, transno 4294967322 00000100:00100000:0.0:1787582848.987716:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b5381f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186243584:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787582849.013659:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+12:2358:x1874416162141952:12345-192.168.206.20@tcp:16:lhsmtool_posix.0 Request processed in 52344us (52543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582849.013673:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 69 00000100:00100000:3.0:1787582849.017088:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582849.017617:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162142336 00000100:00100000:1.0:1787582849.017641:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162142336 00000100:00100000:1.0:1787582849.017710:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 228 00000100:00100000:1.0:1787582849.017720:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+20:11616:x1874416162142336:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787582849.017826:0:12083:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582849.017851:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e600/0xa113d808b7538b5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5832f expref: 20 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.017870:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8da58533f100) 00010000:00010000:1.0:1787582849.017874:0:12083:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787582849.017972:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538b7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.017986:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538b7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.017996:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538b7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787582849.018239:0:12083:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c49422ad reply state 00000000abe002a6 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538b7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582849.018248:0:12083:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:2.0:1787582849.018369:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582849.018957:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+21:11616:x1874416162142336:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 Request processed in 1236us (2198us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1787582849.018964:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 228 00000001:00080000:2.0:1787582849.019165:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:2.0:1787582849.019175:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:2.0:1787582849.019182:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:2.0:1787582849.019187:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00010000:00010000:0.0:1787582849.022809:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538b7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582849.022826:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538b7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582849.022833:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538b7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582849.022840:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582849.022845:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538b7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582849.022852:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538b7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582849.022869:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8da58533f100) 00010000:00010000:0.0:1787582849.022872:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582849.022876:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538b7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582849.022900:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7c00/0xa113d808b7538b7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582849.024383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582849.024718:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162142464 00000100:00100000:3.0:1787582849.024726:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162142464 00000100:00100000:3.0:1787582849.024780:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 70 00000100:00100000:3.0:1787582849.024790:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2359:x1874416162142464:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787582849.025007:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787582849.025011:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787582849 -> 1787582848 00002000:00010000:3.0:1787582849.025013:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787582848 00002000:00010000:3.0:1787582849.025030:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787582849 -> 1787582848 00002000:00010000:3.0:1787582849.025032:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787582849.025098:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2359:x1874416162142464:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 Request processed in 309us (722us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787582849.025107:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 70 00000100:00100000:1.0:1787582849.029585:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582849.029708:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162142720 00000100:00100000:2.0:1787582849.029717:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162142720 00000100:00100000:2.0:1787582849.029772:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 229 00000100:00100000:2.0:1787582849.029781:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+20:11616:x1874416162142720:12345-192.168.206.20@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787582849.029845:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538b86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.029862:0:7653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538b40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58321 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.029871:0:7653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538b86 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.029922:0:7653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58321 expref: 20 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.029937:0:7653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538b40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58321 expref: 20 pid: 5854 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582849.029950:0:7653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da589c7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1874416186243968:192.168.206.20@tcp:104: 00000100:00100000:2.0:1787582849.030037:0:7653:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf328b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582849.034050:0:7653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da589c7d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1874416186243968:192.168.206.20@tcp:104: 00010000:00010000:2.0:1787582849.034078:0:7653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538b86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582849.035744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582849.036362:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162142848 00000100:00100000:3.0:1787582849.036372:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162142848 00010000:00010000:3.0:1787582849.036419:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538b40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58321 expref: 21 pid: 5854 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582849.036460:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 84 00000100:00100000:3.0:1787582849.036470:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588496d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+21:2359:x1874416162142848:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582849.036482:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582849.036489:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538b40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58321 expref: 21 pid: 5854 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.036501:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58321 expref: 21 pid: 5854 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.036534:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6a00/0xa113d808b7538b40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58321 expref: 21 pid: 5854 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.036552:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8da58533f100) 00010000:00010000:3.0:1787582849.036557:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538b86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.036566:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538b86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.036589:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538b86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.036621:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582849.036681:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588496d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+20:2359:x1874416162142848:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 212us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582849.036688:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 84 00010000:00010000:2.0:1787582849.037821:0:7653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538b86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.037833:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538b86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.037861:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538b86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.037868:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538b86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.037874:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538b86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.037890:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9e000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582849.037901:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538b86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.037908:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538b86 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.037922:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8da58533f100) 00010000:00010000:2.0:1787582849.037924:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787582849.037928:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538b86 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.037934:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e000/0xa113d808b7538b86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582849.037995:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:11616:x1874416162142720:12345-192.168.206.20@tcp:55:lhsmtool_posix.0 Request processed in 8214us (8417us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787582849.038013:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 229 00000100:00100000:1.0:1787582849.042694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582849.043021:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162142976 00000100:00100000:3.0:1787582849.043030:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162142976 00000100:00100000:3.0:1787582849.043084:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 71 00000100:00100000:3.0:1787582849.043094:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2358:x1874416162142976:12345-192.168.206.20@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787582849.043156:0:8218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000056c0071b/0xa113d808b7538b8d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.043177:0:8218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be7e1335/0xa113d808b7538b6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5833d expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.043186:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787582849.043190:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787582849.043194:0:8218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056c0071b/0xa113d808b7538b8d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.043226:0:8218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be7e1335/0xa113d808b7538b6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5833d expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.043241:0:8218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be7e1335/0xa113d808b7538b6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5833d expref: 8 pid: 6705 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582849.043280:0:8218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf1ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8218:1874416186244096:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582849.043633:0:8218:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fd0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582849.047385:0:8218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf1ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8218:1874416186244096:192.168.206.20@tcp:104: 00010000:00010000:2.0:1787582849.047422:0:8218:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000056c0071b/0xa113d808b7538b8d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582849.049710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582849.049816:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162143104 00000100:00100000:2.0:1787582849.049824:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162143104 00010000:00010000:2.0:1787582849.049859:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be7e1335/0xa113d808b7538b6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5833d expref: 9 pid: 6705 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582849.049913:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 85 00000100:00100000:2.0:1787582849.049923:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588497800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+9:2360:x1874416162143104:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582849.049937:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582849.049959:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be7e1335/0xa113d808b7538b6a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5833d expref: 9 pid: 6705 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.049974:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be7e1335/0xa113d808b7538b6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5833d expref: 9 pid: 6705 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.049997:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be7e1335/0xa113d808b7538b6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5833d expref: 9 pid: 6705 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.050013:0:5838:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787582849.050018:0:5838:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787582849.050023:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000056c0071b/0xa113d808b7538b8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.050042:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056c0071b/0xa113d808b7538b8d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.050076:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582849.050187:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588497800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2360:x1874416162143104:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 264us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582849.050195:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 85 00010000:00010000:3.0:1787582849.050820:0:8218:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000056c0071b/0xa113d808b7538b8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.050831:0:8218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056c0071b/0xa113d808b7538b8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.050855:0:8218:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000056c0071b/0xa113d808b7538b8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.050862:0:8218:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056c0071b/0xa113d808b7538b8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.050870:0:8218:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056c0071b/0xa113d808b7538b8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.050876:0:8218:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0600 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582849.050897:0:8218:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056c0071b/0xa113d808b7538b8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.050907:0:8218:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056c0071b/0xa113d808b7538b8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.050920:0:8218:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056c0071b/0xa113d808b7538b8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.050935:0:8218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056c0071b/0xa113d808b7538b8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582849.050988:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2358:x1874416162142976:12345-192.168.206.20@tcp:1:lhsmtool_posix.0 Request processed in 7895us (8301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582849.050996:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 71 00000100:00100000:2.0:1787582849.056040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582849.056195:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162143360 00000100:00100000:0.0:1787582849.056204:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162143360 00000100:00100000:0.0:1787582849.056297:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 230 00000100:00100000:0.0:1787582849.056308:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:11616:x1874416162143360:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787582849.056435:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538b94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582849.056469:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538b94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582849.056480:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538b94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582849.056694:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538b9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582849.056706:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538b4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58328 expref: 20 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582849.056715:0:5852:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538b9b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582849.056749:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538b4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58328 expref: 20 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582849.056763:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538b4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58328 expref: 20 pid: 12083 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582849.056778:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b5380380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186244224:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582849.056856:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c600 going to sleep for 11 seconds 00000100:00100000:2.0:1787582849.061094:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b5380380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186244224:192.168.206.20@tcp:104: 00010000:00010000:2.0:1787582849.061187:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538b9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582849.061858:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582849.062070:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162143488 00000100:00100000:3.0:1787582849.062077:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162143488 00010000:00010000:3.0:1787582849.062109:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538b4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58328 expref: 21 pid: 12083 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582849.062169:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 86 00000100:00100000:3.0:1787582849.062178:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+21:2358:x1874416162143488:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582849.062191:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582849.062199:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538b4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58328 expref: 21 pid: 12083 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.062211:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538b4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58328 expref: 21 pid: 12083 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.062231:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538b4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58328 expref: 21 pid: 12083 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.062245:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8da58533f100) 00010000:00010000:3.0:1787582849.062250:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538b9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.062284:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538b9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.062292:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538b9b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.062357:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582849.062771:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+20:2358:x1874416162143488:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 592us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582849.062779:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 86 00010000:00010000:2.0:1787582849.063225:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538b9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.063234:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538b9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787582849.063728:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787582849.063865:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787582849.063922:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787582849.064004:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874416186244352:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787582849.064057:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582849.064144:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf328240 going to sleep for 11 seconds 00000100:00100000:1.0:1787582849.065269:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186244352 00000100:00100000:1.0:1787582849.065606:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186244352 00000100:00100000:1.0:1787582849.065701:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787582849.065711:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1874416186244352:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787582849.065816:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5852:x1874416186244352:12345-0@lo:1000:mdt00_000.0 Request processed in 107us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582849.065823:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787582849.065901:0:5852:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:2.0:1787582849.065908:0:5852:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:2.0:1787582849.065937:0:5852:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8da5b5380700, transno 4294967321 00000100:00100000:2.0:1787582849.065957:0:5852:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8da5b5381f80 x1874416186243584/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787582864 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582849.065969:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874416186244352:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787582849.066464:0:5852:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787582849.066536:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adf79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874416186244480:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787582849.066569:0:5852:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582849.071159:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf328b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787582849.071245:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186244480 00000100:00100000:3.0:1787582849.071254:0:5859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186244480 00000100:00100000:2.0:1787582849.072200:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787582849.072212:0:5859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5852:x1874416186244480:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787582849.072773:0:5859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5852:x1874416186244480:12345-0@lo:1000:mdt00_000.0 Request processed in 563us (6201us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787582849.072781:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787582849.073058:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adf79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5852:1874416186244480:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787582849.073168:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538b9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.073180:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538b9b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.073187:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538b9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.073194:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582849.073198:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538b9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.073206:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538b9b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.073221:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8da58533f100) 00010000:00010000:1.0:1787582849.073224:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787582849.073229:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538b9b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.073234:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee200/0xa113d808b7538b9b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.073264:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538ade lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.073294:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538ade lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.073300:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538ade lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.073305:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9f000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582849.073308:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538ade lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.073313:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538ade lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.073362:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:1.0:1787582849.073364:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787582849.073371:0:5852:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538ae5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5830c expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.073382:0:5852:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538ae5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5830c expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.073390:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538ae5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5830c expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.073421:0:5852:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538ae5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5830c expref: 23 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582849.073433:0:5852:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588494700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186244608:192.168.206.20@tcp:105: 00000100:00100000:1.0:1787582849.074550:0:5852:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1de40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582849.080102:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582849.080227:0:5852:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588494700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5852:1874416186244608:192.168.206.20@tcp:105: 00010000:00010000:1.0:1787582849.080251:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538ade lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080262:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f000/0xa113d808b7538ade lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080304:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538ba2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080341:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538ba2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080353:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538ba2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080363:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538ba2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080369:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538ba2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080376:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538ba2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080382:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582849.080385:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538ba2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080399:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538ba2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080426:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:1.0:1787582849.080429:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582849.080432:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538ba2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080438:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538ba2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080448:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538b94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080453:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538b94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080459:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538b94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080464:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20efe00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582849.080467:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538b94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080472:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538b94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080479:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:1.0:1787582849.080481:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787582849.080483:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538b94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.080488:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20efe00/0xa113d808b7538b94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582849.080683:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+23:11616:x1874416162143360:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 24376us (24651us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1787582849.080693:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 230 00000020:00080000:1.0:1787582849.080699:0:5852:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787582849.081234:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787582849.081239:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787582849.081896:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787582849.081904:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787582849.082579:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162143616 00000100:00100000:0.0:1787582849.082588:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162143616 00000100:00100000:0.0:1787582849.082630:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 61 00000100:00100000:0.0:1787582849.082639:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+23:11615:x1874416162143616:12345-192.168.206.20@tcp:49:lfs.0 00000100:00100000:0.0:1787582849.082757:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+23:11615:x1874416162143616:12345-192.168.206.20@tcp:49:lfs.0 Request processed in 119us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582849.082774:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 61 00000100:00100000:2.0:1787582849.089286:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582849.089512:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162143872 00000100:00100000:3.0:1787582849.089522:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162143872 00000100:00100000:3.0:1787582849.089573:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 62 00000100:00100000:3.0:1787582849.089582:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583665850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+23:11616:x1874416162143872:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787582849.090217:0:11490:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787582849.090357:0:11490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1787582849.090800:0:11490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b7538ba9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.090816:0:11490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b7538ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.090828:0:11490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b7538ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.090837:0:11490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b7538ba9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.090850:0:11490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b7538ba9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.090857:0:11490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b7538ba9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582849.091013:0:11490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787582849.091120:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583665850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+25:11616:x1874416162143872:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 Request processed in 1535us (1853us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1787582849.091130:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 62 00000020:00080000:3.0:1787582849.091135:0:11490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787582849.093511:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582849.093531:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b7538ba9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.093543:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0600 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:1.0:1787582849.093547:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b7538ba9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.093557:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b7538ba9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.093573:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8da583acc600) 00010000:00010000:1.0:1787582849.093577:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787582849.093581:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b7538ba9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.093586:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0600/0xa113d808b7538ba9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.093605:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582849.093607:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582849.093609:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582849.095026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582849.095091:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162144128 00000100:00100000:1.0:1787582849.095100:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162144128 00000100:00100000:1.0:1787582849.095170:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 231 00000100:00100000:1.0:1787582849.095180:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+25:11615:x1874416162144128:12345-192.168.206.20@tcp:58:lfs.0 00000040:00080000:1.0:1787582849.095877:0:12083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787582849.095965:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+25:11615:x1874416162144128:12345-192.168.206.20@tcp:58:lfs.0 Request processed in 785us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582849.095972:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 231 00000100:00100000:3.0:1787582849.166737:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582849.167016:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162144256 00000100:00100000:1.0:1787582849.167026:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162144256 00000100:00100000:1.0:1787582849.167077:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 232 00000100:00100000:1.0:1787582849.167087:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+25:11618:x1874416162144256:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:1.0:1787582849.167110:0:7653:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582849.167139:0:7653:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538bb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58344 expref: -99 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.167210:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538bb7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.167224:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.167236:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.167250:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538bbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.167256:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.167263:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.167880:0:7653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7538bc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.167902:0:7653:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58305 expref: 26 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.167910:0:7653:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7538bc5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.167944:0:7653:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58305 expref: 26 pid: 12083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582849.167959:0:7653:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58305 expref: 26 pid: 12083 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582849.167973:0:7653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da588494700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1874416186244736:192.168.206.20@tcp:104: 00000100:00100000:1.0:1787582849.168058:0:7653:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1de40 going to sleep for 11 seconds 00000100:00100000:1.0:1787582849.173768:0:7653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da588494700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7653:1874416186244736:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582849.173796:0:7653:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7538bc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582849.174183:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582849.174824:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162144512 00000100:00100000:2.0:1787582849.174833:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162144512 00000100:00100000:2.0:1787582849.174878:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 63 00000100:00100000:2.0:1787582849.175660:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+27:5597:x1874416162144512:12345-192.168.206.20@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787582849.175882:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+28:5597:x1874416162144512:12345-192.168.206.20@tcp:35:ldlm_bl.0 Request processed in 993us (1698us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787582849.179033:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 63 00000100:00100000:3.0:1787582849.179929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582849.180109:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162144640 00000100:00100000:2.0:1787582849.180118:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162144640 00010000:00010000:2.0:1787582849.180164:0:5838:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58305 expref: 28 pid: 12083 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582849.180199:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 87 00000100:00100000:2.0:1787582849.180207:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+28:2360:x1874416162144640:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582849.180220:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582849.180227:0:5838:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58305 expref: 28 pid: 12083 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180240:0:5838:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58305 expref: 28 pid: 12083 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180259:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20eee00/0xa113d808b7538ad0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58305 expref: 28 pid: 12083 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180284:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:2.0:1787582849.180289:0:5838:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7538bc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180299:0:5838:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7538bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180307:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7538bc5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180352:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582849.180399:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+27:2360:x1874416162144640:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 184us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582849.180415:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 87 00010000:00010000:2.0:1787582849.180444:0:7653:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7538bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180451:0:7653:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7538bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582849.180491:0:7653:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787582849.180494:0:7653:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787582849.180511:0:7653:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7538bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180618:0:7653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7538bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180630:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180637:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538bb7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180644:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180649:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582849.180653:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180660:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538bb7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180669:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:2.0:1787582849.180676:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582849.180680:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538bb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180686:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538bb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180696:0:7653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538bbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180702:0:7653:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538bbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180709:0:7653:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180713:0:7653:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582849.180716:0:7653:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538bbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180721:0:7653:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538bbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180727:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8da58533f100) 00010000:00010000:2.0:1787582849.180729:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582849.180732:0:7653:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538bbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180737:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538bbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7653 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180764:0:7653:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6200/0xa113d808b7538bb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58344 expref: 27 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180786:0:7653:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7538bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58344 expref: 26 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582849.180793:0:7653:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:2.0:1787582849.180795:0:7653:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787582849.180797:0:7653:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7000, rc 0) 00000100:00100000:2.0:1787582849.180818:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:11618:x1874416162144256:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 13734us (14091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582849.180825:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 232 00000001:00080000:1.0:1787582849.198157:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1787582849.198177:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1787582849.198185:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:2.0:1787582849.489639:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582850.002912:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582850.002956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582850.003047:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162144896 00000100:00100000:1.0:1787582850.003056:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162144896 00000100:00100000:1.0:1787582850.003111:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 158 00000100:00100000:1.0:1787582850.003132:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:2359:x1874416162144896:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582850.003230:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:2359:x1874416162144896:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 111us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582850.003237:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 158 00000100:00100000:3.0:1787582850.003806:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162145152 00000100:00100000:3.0:1787582850.003811:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162145152 00000100:00100000:3.0:1787582850.003871:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 91 00000100:00100000:3.0:1787582850.003888:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162145152:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582850.003935:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162145152:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 56us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582850.003941:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 91 00000100:00080000:2.0:1787582850.004380:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787582850.006813:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582850.006909:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162144768 00000100:00100000:0.0:1787582850.006917:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162144768 00000100:00100000:0.0:1787582850.006966:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 298 00000100:00100000:0.0:1787582850.006976:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162144768:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582850.007044:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162144768:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 69us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582850.007051:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 298 00000100:00100000:1.0:1787582850.011158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582850.011218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582850.011359:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162145280 00000100:00100000:3.0:1787582850.011369:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162145280 00000100:00100000:3.0:1787582850.011430:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 159 00000100:00100000:3.0:1787582850.011440:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:83345526-3920-4b94-b598-4d9f74280322+5:2360:x1874416162145280:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582850.011507:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:83345526-3920-4b94-b598-4d9f74280322+5:2360:x1874416162145280:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 69us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582850.011524:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 159 00000100:00100000:2.0:1787582850.011826:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162145024 00000100:00100000:2.0:1787582850.011831:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162145024 00000100:00100000:2.0:1787582850.011862:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 92 00000100:00100000:2.0:1787582850.011870:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2360:x1874416162145024:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582850.011914:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2360:x1874416162145024:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 45us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582850.011921:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 92 00000100:00080000:0.0:1787582850.012050:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787582850.012056:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787582850.130277:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787582850.130284:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787582850.130358:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787582850.130365:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787582850.130466:0:11695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf1adf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11695:1874416186244992:192.168.206.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787582850.130547:0:11695:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fd0300 going to sleep for 11 seconds 00000100:00100000:0.0:1787582850.130612:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da586c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186244864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787582850.130652:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582850.133743:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186244864 00000100:00100000:3.0:1787582850.133755:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186244864 00000100:00100000:3.0:1787582850.133841:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787582850.133850:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5380700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874416186244864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787582850.133890:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582850.133955:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5380700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874416186244864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (3302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582850.133961:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787582850.135436:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787582850.135487:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da586c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186244864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787582850.137721:0:11695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf1adf80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11695:1874416186244992:192.168.206.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787582850.138647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582850.138700:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162145408 00000100:00100000:2.0:1787582850.138706:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162145408 00000100:00100000:2.0:1787582850.138760:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 233 00000100:00100000:2.0:1787582850.138780:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:11629:x1874416162145408:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787582850.138804:0:7653:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787582850.138904:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:11629:x1874416162145408:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 Request processed in 124us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582850.138911:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 233 00000100:00100000:0.0:1787582850.147207:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582850.147615:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162145664 00000100:00100000:1.0:1787582850.147624:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162145664 00000100:00100000:1.0:1787582850.147679:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 234 00000100:00100000:1.0:1787582850.147689:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+26:11629:x1874416162145664:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787582850.147707:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582850.147725:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538bcc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5834b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582850.147811:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538bd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582850.147824:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582850.147848:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582850.147859:0:5855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787582850.147972:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7400/0xa113d808b7538bcc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5834b expref: 29 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582850.147989:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5834b expref: 28 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582850.148014:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:1.0:1787582850.148017:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582850.148020:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6e00, rc 0) 00000100:00100000:1.0:1787582850.148085:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5380a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+28:11629:x1874416162145664:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 397us (887us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1787582850.148092:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 234 00000100:00100000:3.0:1787582850.163533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582850.163563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582850.163658:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162145920 00000100:00100000:1.0:1787582850.163666:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162145920 00000100:00100000:1.0:1787582850.163716:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 235 00000100:00100000:1.0:1787582850.163725:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+28:11629:x1874416162145920:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787582850.163790:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538be1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582850.163805:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538be1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582850.163816:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538be1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582850.163986:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538be1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582850.163994:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538be1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582850.164001:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538be1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582850.164018:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582850.164022:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538be1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582850.164125:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538be1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582850.164138:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:1.0:1787582850.164160:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787582850.164165:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538be1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582850.164171:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6600/0xa113d808b7538be1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582850.164554:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+29:11629:x1874416162145920:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 828us (1027us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787582850.164562:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 235 00000100:00100000:1.0:1787582850.164585:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162146048 00000100:00100000:1.0:1787582850.164589:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162146048 00000100:00100000:1.0:1787582850.164616:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:1.0:1787582850.164622:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+29:2360:x1874416162146048:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582850.164632:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582850.164645:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6e00/0xa113d808b7538bd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5834b expref: 29 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582850.164655:0:8463:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:1.0:1787582850.164659:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582850.164682:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c5b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+28:2360:x1874416162146048:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 60us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582850.164689:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 16 00000040:00080000:2.0:1787582850.166279:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787582850.166286:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787582850.166942:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787582850.166950:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787582850.192494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582850.192594:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162146304 00000100:00100000:0.0:1787582850.192603:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162146304 00000100:00100000:0.0:1787582850.192651:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 64 00000100:00100000:0.0:1787582850.192661:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+28:11629:x1874416162146304:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787582850.192867:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+29:11629:x1874416162146304:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 Request processed in 206us (381us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787582850.192876:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 64 00000040:00080000:0.0:1787582850.332534:0:12527:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787582850.332542:0:12527:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787582850.332583:0:12527:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787582850.332593:0:12527:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787582850.518083:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582850.618833:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582850.618898:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162146560 00000100:00100000:3.0:1787582850.618907:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162146560 00000100:00100000:3.0:1787582850.618958:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 236 00000100:00100000:3.0:1787582850.618968:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+29:11642:x1874416162146560:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:3.0:1787582850.618990:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582850.619009:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538be8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58352 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.619127:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7538bef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.619152:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7538bef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.619164:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7538bef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582850.619174:0:5852:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787582850.619277:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1000/0xa113d808b7538be8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58352 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.619293:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7538bef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58352 expref: 31 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.619302:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:3.0:1787582850.619305:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787582850.619308:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0400, rc 0) 00000100:00100000:3.0:1787582850.619535:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+31:11642:x1874416162146560:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 567us (708us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787582850.619543:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 236 00000100:00100000:1.0:1787582850.624292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582850.624398:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162146688 00000100:00100000:3.0:1787582850.624407:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162146688 00000100:00100000:3.0:1787582850.624522:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 237 00000100:00100000:3.0:1787582850.624532:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da588497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+31:11642:x1874416162146688:12345-192.168.206.20@tcp:54:lfs.0 00010000:00010000:3.0:1787582850.624592:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538bfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.624618:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.624630:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.624654:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.624661:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538bfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.624667:0:12083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538bfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.624673:0:12083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787582850.624677:0:12083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538bfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.624684:0:12083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538bfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.624694:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:3.0:1787582850.624697:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787582850.624702:0:12083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538bfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.624708:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1400/0xa113d808b7538bfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582850.624764:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da588497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+31:11642:x1874416162146688:12345-192.168.206.20@tcp:54:lfs.0 Request processed in 233us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582850.624775:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 237 00000100:00100000:0.0:1787582850.782809:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582850.785258:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162146816 00000100:00100000:3.0:1787582850.785270:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162146816 00000100:00100000:3.0:1787582850.785389:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 72 00000100:00100000:3.0:1787582850.785399:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2360:x1874416162146816:12345-192.168.206.20@tcp:101:cat.0 00010000:00010000:3.0:1787582850.785417:0:8218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582850.785435:0:8218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebb99f24/0xa113d808b7538c04 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58359 expref: -99 pid: 8218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787582850.785460:0:8218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8c5980, atime: 0x6a8c5980, ctime: 0x6a8c5980, blocks: 0xb 00010000:00010000:3.0:1787582850.785477:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=391s v=(0 0) 00010000:00010000:3.0:1787582850.785481:0:8218:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582850.785490:0:8218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebb99f24/0xa113d808b7538c04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58359 expref: 8 pid: 8218 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.785506:0:8218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ebb99f24/0xa113d808b7538c04 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58359 expref: 8 pid: 8218 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582850.785536:0:8218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1400, rc 0) 00000100:00100000:3.0:1787582850.785595:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2360:x1874416162146816:12345-192.168.206.20@tcp:101:cat.0 Request processed in 197us (2793us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582850.785602:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 72 00000100:00100000:0.0:1787582850.791778:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582850.792573:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162146944 00000100:00100000:2.0:1787582850.792584:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162146944 00002000:00100000:2.0:1787582850.792629:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8da5b5382a00 x1874416162146944/t0(0) o3->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:316/0 lens 488/0 e 0 to 0 dl 1787582861 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787582850.792641:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5b5382a00 with x1874416162146944 ext(0->4095) 00002000:00010000:2.0:1787582850.792646:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da5b5382a00 00000100:00100000:2.0:1787582850.792679:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 7 00000100:00100000:2.0:1787582850.792687:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2359:x1874416162146944:12345-192.168.206.20@tcp:3:cat.0 00000100:00100000:2.0:1787582850.792872:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+8:2359:x1874416162146944:12345-192.168.206.20@tcp:3:cat.0 Request processed in 185us (1103us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787582850.792880:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 7 00002000:00100000:2.0:1787582850.792887:0:6709:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8da5b5382a00 x1874416162146944/t0(0) o3->730f9f4f-46d8-441e-9162-5fde1074d6a5@192.168.206.20@tcp:316/0 lens 488/4536 e 0 to 0 dl 1787582861 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787582850.792896:0:6709:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8da5b5382a00 with x1874416162146944 ext(0->4095) 00002000:00010000:2.0:1787582850.792899:0:6709:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8da5b5382a00 00000100:00100000:1.0:1787582851.152626:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da586c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186245248:0@lo:400:kworker.0 00000100:00100000:1.0:1787582851.152693:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582851.152745:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186245760:0@lo:400:kworker.0 00000100:00100000:1.0:1787582851.152767:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582851.152794:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582851.152798:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da586c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186245376:0@lo:400:kworker.0 00000100:00100000:1.0:1787582851.152816:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582851.152853:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186245760 00000100:00100000:1.0:1787582851.152859:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186245760 00000100:00100000:1.0:1787582851.152902:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186245376 00000100:00100000:1.0:1787582851.152905:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186245376 00000100:00100000:1.0:1787582851.152922:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787582851.152929:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186245760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582851.152970:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186245760:12345-0@lo:400:kworker.0 Request processed in 42us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582851.152977:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787582851.152991:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787582851.152996:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1874416186245376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582851.153018:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1874416186245376:12345-0@lo:400:kworker.0 Request processed in 22us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582851.153023:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787582851.153083:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da586c7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186245376:0@lo:400:kworker.0 00000100:00100000:1.0:1787582851.153092:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1787582851.153096:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8da5bf226d80, transno 4294967307 00000004:00080000:1.0:1787582851.153104:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1787582851.153127:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8da5bf1aed80, transno 4294967310 00000100:00100000:1.0:1787582851.153132:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186245760:0@lo:400:kworker.0 00000100:00100000:2.0:1787582851.153569:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186245248 00000100:00100000:2.0:1787582851.153579:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186245248 00000100:00100000:2.0:1787582851.153612:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787582851.153618:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186245248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582851.153657:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186245248:12345-0@lo:400:kworker.0 Request processed in 39us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582851.153663:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787582851.153685:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da586c7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186245248:0@lo:400:kworker.0 00000100:00100000:3.0:1787582851.153751:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da586c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186245504:0@lo:400:kworker.0 00000100:00100000:3.0:1787582851.153779:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582851.153805:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787582851.153816:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da586c7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186245120:0@lo:400:kworker.0 00000100:00100000:3.0:1787582851.153848:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582851.153868:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186245632:0@lo:400:kworker.0 00000100:00100000:3.0:1787582851.153887:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582851.154353:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186245120 00000100:00100000:3.0:1787582851.154358:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186245120 00000100:00100000:3.0:1787582851.154383:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787582851.154389:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186245120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582851.154423:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3311:x1874416186245120:12345-0@lo:400:kworker.0 Request processed in 34us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582851.154430:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787582851.154450:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186245504 00000100:00100000:3.0:1787582851.154453:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186245504 00000100:00100000:3.0:1787582851.154470:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186245632 00000100:00100000:3.0:1787582851.154472:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186245632 00000100:00100000:3.0:1787582851.154486:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787582851.154494:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186245504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582851.154518:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186245504:12345-0@lo:400:kworker.0 Request processed in 27us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582851.154523:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787582851.154533:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787582851.154538:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186245632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582851.154558:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874416186245632:12345-0@lo:400:kworker.0 Request processed in 20us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582851.154563:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787582851.154584:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da586c7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186245120:0@lo:400:kworker.0 00000100:00100000:3.0:1787582851.154604:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874416186245632:0@lo:400:kworker.0 00000100:00100000:3.0:1787582851.154612:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da586c7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186245504:0@lo:400:kworker.0 00000100:00080000:0.0:1787582851.154802:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787582851.154807:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787582851.536538:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582851.673182:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5b5383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186245888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787582851.673245:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582851.673313:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186245888 00000100:00100000:0.0:1787582851.673336:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186245888 00000100:00100000:0.0:1787582851.673375:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787582851.673383:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5380380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186245888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787582851.673415:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582851.673452:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5380380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186245888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582851.673459:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787582851.673499:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5b5383b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186245888:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787582852.240545:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787582852.240553:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787582852.240581:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787582852.240587:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787582852.560452:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582853.584644:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787582854.370650:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:2.0:1787582854.370674:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1787582854.408672:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:3.0:1787582854.408715:0:5876:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8da5bf328240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787582854.408721:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da5a0106100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8da5bf328e40 00000020:00080000:3.0:1787582854.408725:0:5876:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8da58b268c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8da5bf283800 00000001:00080000:3.0:1787582854.408751:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1787582854.408760:0:5876:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1787582854.410212:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787582854.410479:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1787582854.635211:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582855.131246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582855.131432:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162147072 00000100:00100000:2.0:1787582855.131445:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162147072 00000100:00100000:2.0:1787582855.131514:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 300 00000100:00100000:2.0:1787582855.131526:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162147072:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582855.131622:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2360:x1874416162147072:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 98us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582855.131631:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 300 00000100:00100000:0.0:1787582855.141540:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582855.141616:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582855.141646:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582855.141670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582855.141702:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162147456 00000100:00100000:0.0:1787582855.141714:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162147456 00000100:00100000:0.0:1787582855.141779:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162147328 00000100:00100000:0.0:1787582855.141783:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162147328 00000100:00100000:0.0:1787582855.141810:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 95 00000100:00100000:0.0:1787582855.141820:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162147456:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582855.141928:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2359:x1874416162147456:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 108us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582855.141937:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 95 00000100:00100000:0.0:1787582855.141957:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 96 00000100:00100000:0.0:1787582855.141965:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2360:x1874416162147328:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582855.141995:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2360:x1874416162147328:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 31us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582855.142002:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 96 00000100:00100000:0.0:1787582855.142025:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162147200 00000100:00100000:0.0:1787582855.142028:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162147200 00000100:00100000:0.0:1787582855.142060:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162147584 00000100:00100000:0.0:1787582855.142063:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162147584 00000100:00100000:0.0:1787582855.142084:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 163 00000100:00100000:0.0:1787582855.142091:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b5383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:2359:x1874416162147200:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582855.142138:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b5383b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:2359:x1874416162147200:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 47us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582855.142145:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 163 00000100:00100000:0.0:1787582855.142157:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 164 00000100:00100000:0.0:1787582855.142164:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83345526-3920-4b94-b598-4d9f74280322+5:2360:x1874416162147584:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582855.142188:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83345526-3920-4b94-b598-4d9f74280322+5:2360:x1874416162147584:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 25us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582855.142194:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 164 00000100:00080000:0.0:1787582855.142211:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787582855.142216:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787582855.142218:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787582855.248811:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186246016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787582855.248902:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582855.255809:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186246016 00000100:00100000:0.0:1787582855.255823:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186246016 00000100:00100000:0.0:1787582855.255912:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787582855.255923:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186246016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787582855.255960:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582855.256105:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186246016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (7202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582855.256126:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787582855.256283:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1787582855.256289:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8da5b5381f80, transno 4294967322 00000004:00080000:3.0:1787582855.256308:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1787582855.256363:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186246016:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787582855.258758:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787582855.697165:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582856.272948:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186246272:0@lo:400:kworker.0 00000100:00100000:2.0:1787582856.273015:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582856.273066:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186246784:0@lo:400:kworker.0 00000100:00100000:2.0:1787582856.273120:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582856.273154:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787582856.273161:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186246400:0@lo:400:kworker.0 00000100:00100000:2.0:1787582856.273183:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582856.273216:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186246272 00000100:00100000:2.0:1787582856.273223:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186246272 00000100:00100000:2.0:1787582856.273267:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787582856.273275:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186246272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582856.273342:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186246272:12345-0@lo:400:kworker.0 Request processed in 68us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582856.273349:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787582856.273370:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186246784 00000100:00100000:2.0:1787582856.273374:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186246784 00000100:00100000:2.0:1787582856.273407:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186246400 00000100:00100000:2.0:1787582856.273410:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186246400 00000100:00100000:2.0:1787582856.273431:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787582856.273437:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186246784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582856.273468:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186246784:12345-0@lo:400:kworker.0 Request processed in 32us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582856.273474:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787582856.273484:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787582856.273490:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186246400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582856.273513:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186246400:12345-0@lo:400:kworker.0 Request processed in 24us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582856.273519:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1787582856.273537:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787582856.273568:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186246400:0@lo:400:kworker.0 00000100:00100000:2.0:1787582856.273589:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186246272:0@lo:400:kworker.0 00000100:00100000:2.0:1787582856.273598:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186246784:0@lo:400:kworker.0 00000100:00100000:1.0:1787582856.273779:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186246144:0@lo:400:kworker.0 00000100:00100000:1.0:1787582856.273825:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582856.273850:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186246656:0@lo:400:kworker.0 00000100:00100000:1.0:1787582856.273872:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582856.273891:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582856.273897:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186246528:0@lo:400:kworker.0 00000100:00100000:1.0:1787582856.273915:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582856.273941:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186246144 00000100:00100000:1.0:1787582856.273944:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186246144 00000100:00100000:1.0:1787582856.273972:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787582856.273978:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186246144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582856.274012:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186246144:12345-0@lo:400:kworker.0 Request processed in 34us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582856.274018:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1787582856.274042:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186246656 00000100:00100000:1.0:1787582856.274045:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186246656 00000100:00100000:1.0:1787582856.274081:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186246528 00000100:00100000:1.0:1787582856.274085:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186246528 00000100:00100000:1.0:1787582856.274103:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787582856.274121:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186246656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582856.274152:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186246656:12345-0@lo:400:kworker.0 Request processed in 33us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582856.274157:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787582856.274168:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787582856.274174:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186246528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582856.274200:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186246528:12345-0@lo:400:kworker.0 Request processed in 26us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582856.274206:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1787582856.274230:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582856.274248:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186246528:0@lo:400:kworker.0 00000100:00100000:1.0:1787582856.274256:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186246144:0@lo:400:kworker.0 00000100:00100000:1.0:1787582856.274265:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186246656:0@lo:400:kworker.0 00010000:00010000:0.0:1787582856.725077:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582856.784679:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186246912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582856.784781:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582856.785160:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186246912 00000100:00100000:3.0:1787582856.785239:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186246912 00000100:00100000:3.0:1787582856.785614:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787582856.785628:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5a8c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186246912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787582856.785688:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582856.785756:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5a8c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186246912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582856.785763:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787582856.785887:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186246912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787582857.611732:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582857.611848:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162147712 00000100:00100000:2.0:1787582857.611858:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162147712 00000100:00100000:2.0:1787582857.611943:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 238 00000100:00100000:2.0:1787582857.611954:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:11304:x1874416162147712:12345-192.168.206.20@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787582857.612066:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:11304:x1874416162147712:12345-192.168.206.20@tcp:60:lhsmtool_posix.0 Request processed in 113us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582857.612073:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 238 00000100:00080000:1.0:1787582857.612859:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582857.627621:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582857.629739:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162147968 00000100:00100000:0.0:1787582857.629755:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162147968 00000100:00100000:0.0:1787582857.629832:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 65 00000100:00100000:0.0:1787582857.629843:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:11304:x1874416162147968:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787582857.631009:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:11304:x1874416162147968:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 Request processed in 1162us (3399us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1787582857.631019:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 65 00010000:00010000:1.0:1787582857.744698:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582857.925728:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582857.925825:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162148096 00000100:00100000:1.0:1787582857.925834:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162148096 00000100:00100000:1.0:1787582857.925909:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 239 00000100:00100000:1.0:1787582857.925920:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83345526-3920-4b94-b598-4d9f74280322+5:12094:x1874416162148096:12345-192.168.206.20@tcp:101:lsof.0 00010000:00010000:1.0:1787582857.925952:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582857.925971:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538c0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58360 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582857.926030:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538c12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582857.926043:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538c12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582857.926055:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538c12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582857.926252:0:5854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787582857.926257:0:5854:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582857.926376:0:5854:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538c12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582857.926402:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7200/0xa113d808b7538c0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58360 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582857.926419:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538c12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58360 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582857.926427:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68800) 00010000:00010000:1.0:1787582857.926430:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787582857.926434:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7600, rc 0) 00000100:00100000:1.0:1787582857.926493:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:83345526-3920-4b94-b598-4d9f74280322+6:12094:x1874416162148096:12345-192.168.206.20@tcp:101:lsof.0 Request processed in 574us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582857.926500:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 239 00000100:00080000:2.0:1787582857.928439:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787582858.771478:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787582859.415109:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787582859.415125:0:5876:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787582859.415216:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787582859.415240:0:5887:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787582859.792878:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582860.255874:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582860.255918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582860.255954:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582860.255986:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582860.256038:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582860.256078:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162148736 00000100:00100000:1.0:1787582860.256103:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162148736 00000100:00100000:1.0:1787582860.256160:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162148352 00000100:00100000:1.0:1787582860.256163:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162148352 00000100:00100000:1.0:1787582860.256188:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 168 00000100:00100000:1.0:1787582860.256199:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83345526-3920-4b94-b598-4d9f74280322+6:2358:x1874416162148736:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582860.256264:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:83345526-3920-4b94-b598-4d9f74280322+6:2358:x1874416162148736:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 67us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582860.256272:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 168 00000100:00100000:1.0:1787582860.256290:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 169 00000100:00100000:1.0:1787582860.256297:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:2358:x1874416162148352:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582860.256360:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:2358:x1874416162148352:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 63us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582860.256366:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 169 00000100:00100000:2.0:1787582860.256724:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162148480 00000100:00100000:2.0:1787582860.256730:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162148480 00000100:00100000:2.0:1787582860.256766:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162148608 00000100:00100000:2.0:1787582860.256770:0:6703:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162148608 00000100:00100000:2.0:1787582860.256794:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 99 00000100:00100000:2.0:1787582860.256802:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2358:x1874416162148480:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582860.256840:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2358:x1874416162148480:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 39us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582860.256847:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 99 00000100:00100000:2.0:1787582860.256860:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 100 00000100:00100000:2.0:1787582860.256866:0:6703:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162148608:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582860.256893:0:6703:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162148608:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 28us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582860.256912:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 100 00000100:00080000:2.0:1787582860.256932:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787582860.256936:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787582860.256938:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582860.257121:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162148224 00000100:00100000:3.0:1787582860.257126:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162148224 00000100:00100000:3.0:1787582860.257193:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 302 00000100:00100000:3.0:1787582860.257202:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2358:x1874416162148224:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582860.257235:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589de2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2358:x1874416162148224:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 35us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582860.257241:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 302 00000100:00100000:1.0:1787582860.368728:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582860.368750:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186247040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582860.368816:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582860.369002:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186247040 00000100:00100000:0.0:1787582860.369010:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186247040 00000100:00100000:0.0:1787582860.369102:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787582860.369112:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186247040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787582860.369145:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582860.369201:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186247040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582860.369220:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787582860.369391:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186247040:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787582860.369446:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787582860.818793:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582861.401470:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186247168:0@lo:400:kworker.0 00000100:00100000:1.0:1787582861.401945:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582861.402240:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787582861.402251:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186247296:0@lo:400:kworker.0 00000100:00100000:1.0:1787582861.402291:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582861.402408:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186247168 00000100:00100000:0.0:1787582861.402418:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186247168 00000100:00100000:0.0:1787582861.402471:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787582861.402481:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186247168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582861.402549:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186247168:12345-0@lo:400:kworker.0 Request processed in 69us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582861.402567:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787582861.403122:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186247296 00000100:00100000:1.0:1787582861.403129:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186247296 00000100:00100000:1.0:1787582861.403206:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787582861.403215:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186247296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582861.403275:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186247296:12345-0@lo:400:kworker.0 Request processed in 61us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582861.403281:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787582861.409554:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186247168:0@lo:400:kworker.0 00000100:00100000:0.0:1787582861.409656:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186247552:0@lo:400:kworker.0 00000100:00100000:3.0:1787582861.409663:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787582861.409712:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186247424:0@lo:400:kworker.0 00000100:00100000:0.0:1787582861.409716:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582861.409796:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186247680:0@lo:400:kworker.0 00000100:00100000:3.0:1787582861.409808:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582861.409844:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582861.409875:0:12082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186247424 00000100:00100000:3.0:1787582861.409885:0:12082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186247424 00000100:00100000:0.0:1787582861.409921:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186247808:0@lo:400:kworker.0 00000100:00100000:3.0:1787582861.409966:0:12082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787582861.409986:0:12082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186247424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582861.413952:0:12082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186247424:12345-0@lo:400:kworker.0 Request processed in 3962us (4137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582861.413968:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582861.413971:0:12082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787582861.414055:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad930e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186247424:0@lo:400:kworker.0 00000100:00100000:1.0:1787582861.414088:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186247552 00000100:00100000:1.0:1787582861.414101:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186247552 00000100:00100000:1.0:1787582861.414180:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186247680 00000100:00100000:1.0:1787582861.414183:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186247680 00000100:00100000:1.0:1787582861.414212:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787582861.414233:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186247552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582861.414305:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186247552:12345-0@lo:400:kworker.0 Request processed in 84us (4592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582861.414312:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787582861.414352:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787582861.414359:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186247680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582861.414397:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186247680:12345-0@lo:400:kworker.0 Request processed in 38us (4554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582861.414403:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787582861.414453:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186247296:0@lo:400:kworker.0 00000100:00080000:1.0:1787582861.414487:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582861.414513:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186247552:0@lo:400:kworker.0 00000100:00100000:1.0:1787582861.415113:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186247680:0@lo:400:kworker.0 00000100:00100000:0.0:1787582861.419486:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186247808 00000100:00100000:0.0:1787582861.419501:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186247808 00000100:00100000:0.0:1787582861.419599:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787582861.419610:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186247808:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787582861.419670:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787582861.419831:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186247808:12345-0@lo:400:kworker.0 Request processed in 223us (5869us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582861.419841:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787582861.419902:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186247808:0@lo:400:kworker.0 00000001:02000400:2.0:1787582861.749304:0:12730:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:47:40 (1787582860) 00010000:00010000:2.0:1787582861.844446:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582861.904713:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186247936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582861.904814:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582861.906137:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186247936 00000100:00100000:1.0:1787582861.906151:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186247936 00000100:00100000:1.0:1787582861.906220:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787582861.906233:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186247936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787582861.906280:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582861.906416:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186247936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582861.906426:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787582861.906462:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186247936:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787582862.480759:0:11695:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787582862.480772:0:11695:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787582862.481767:0:11695:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787582862.481778:0:11695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787582862.864562:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582863.889142:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582864.912622:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582865.363432:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582865.363468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582865.363504:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582865.363521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582865.363543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582865.363572:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162148992 00000100:00100000:0.0:1787582865.363581:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162148992 00000100:00100000:0.0:1787582865.363630:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162149376 00000100:00100000:0.0:1787582865.363633:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162149376 00000100:00100000:0.0:1787582865.363657:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 173 00000100:00100000:0.0:1787582865.363666:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:2358:x1874416162148992:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582865.363733:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:2358:x1874416162148992:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 68us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582865.363740:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 173 00000100:00100000:0.0:1787582865.363755:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 174 00000100:00100000:0.0:1787582865.363762:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:83345526-3920-4b94-b598-4d9f74280322+6:2358:x1874416162149376:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582865.363787:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:83345526-3920-4b94-b598-4d9f74280322+6:2358:x1874416162149376:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 25us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582865.363792:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 174 00000100:00100000:3.0:1787582865.364037:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162149248 00000100:00100000:3.0:1787582865.364069:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162149248 00000100:00100000:3.0:1787582865.364109:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162149120 00000100:00100000:3.0:1787582865.364112:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162149120 00000100:00100000:3.0:1787582865.364134:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 103 00000100:00100000:3.0:1787582865.364142:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162149248:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582865.364167:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2358:x1874416162149248:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 28us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582865.364173:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 103 00000100:00100000:3.0:1787582865.364183:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 104 00000100:00100000:3.0:1787582865.364189:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2358:x1874416162149120:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582865.364209:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad933100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2358:x1874416162149120:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 21us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582865.364215:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 104 00000100:00100000:2.0:1787582865.368128:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162148864 00000100:00100000:2.0:1787582865.368143:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162148864 00000100:00100000:2.0:1787582865.368224:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 304 00000100:00100000:2.0:1787582865.368236:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2358:x1874416162148864:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582865.368305:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2358:x1874416162148864:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 71us (4799us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582865.368313:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 304 00000100:00080000:3.0:1787582865.368451:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787582865.368458:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787582865.368463:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582865.489734:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186248064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582865.489802:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582865.490066:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186248064 00000100:00100000:3.0:1787582865.490074:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186248064 00000100:00100000:3.0:1787582865.490144:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787582865.490154:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186248064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787582865.490185:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787582865.490302:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582865.490387:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186248064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 233us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582865.490396:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787582865.490531:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186248064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787582865.938557:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582866.270651:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582866.271037:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162149632 00000100:00100000:3.0:1787582866.271048:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162149632 00000100:00100000:3.0:1787582866.271116:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 66 00000100:00100000:3.0:1787582866.271138:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+18:12315:x1874416162149632:12345-192.168.206.20@tcp:35:umount.0 00000100:00100000:3.0:1787582866.271669:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:12315:x1874416162149632:12345-192.168.206.20@tcp:35:umount.0 Request processed in 531us (1023us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787582866.271679:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 66 00000100:00100000:2.0:1787582866.284561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582866.284650:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162149888 00000100:00100000:3.0:1787582866.284659:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162149888 00000100:00100000:3.0:1787582866.284718:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 67 00000100:00100000:3.0:1787582866.284737:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+19:12315:x1874416162149888:12345-192.168.206.20@tcp:35:umount.0 00000100:00100000:3.0:1787582866.285088:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:730f9f4f-46d8-441e-9162-5fde1074d6a5+20:12315:x1874416162149888:12345-192.168.206.20@tcp:35:umount.0 Request processed in 360us (534us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787582866.285096:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 67 00000100:00100000:1.0:1787582866.293304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582866.293400:0:11490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162150144 00000100:00100000:0.0:1787582866.293409:0:11490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162150144 00000100:00100000:0.0:1787582866.293460:0:11490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 68 00000100:00100000:0.0:1787582866.293471:0:11490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583664450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+20:12315:x1874416162150144:12345-192.168.206.20@tcp:35:umount.0 00000100:00100000:0.0:1787582866.294069:0:11490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583664450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:730f9f4f-46d8-441e-9162-5fde1074d6a5+21:12315:x1874416162150144:12345-192.168.206.20@tcp:35:umount.0 Request processed in 597us (771us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787582866.294089:0:11490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 68 00000100:00100000:1.0:1787582866.304877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582866.305367:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162150400 00000100:00100000:0.0:1787582866.305377:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162150400 00000100:00100000:0.0:1787582866.305431:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 69 00000100:00100000:0.0:1787582866.305442:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+21:12315:x1874416162150400:12345-192.168.206.20@tcp:35:umount.0 00000100:00100000:0.0:1787582866.306434:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+22:12315:x1874416162150400:12345-192.168.206.20@tcp:35:umount.0 Request processed in 988us (1561us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787582866.306444:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 69 00000100:00100000:2.0:1787582866.321629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582866.321666:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582866.321697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582866.321793:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162150528 00000100:00100000:1.0:1787582866.321802:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162150528 00000100:00100000:1.0:1787582866.321868:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162150784 00000100:00100000:1.0:1787582866.321872:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162150784 00000100:00100000:1.0:1787582866.321887:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162150656 00000100:00100000:1.0:1787582866.321890:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162150656 00000100:00100000:1.0:1787582866.321906:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 17 00000100:00100000:1.0:1787582866.321914:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9575074-4197-4fbd-89bc-d0d7fb5499a5+15:2359:x1874416162150528:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582866.321926:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582866.321944:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da581687000/0xa113d808b7537c28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57eeb expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582866.321979:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582866.322022:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9575074-4197-4fbd-89bc-d0d7fb5499a5+14:2359:x1874416162150528:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 109us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582866.322038:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 17 00000100:00100000:1.0:1787582866.322065:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 18 00000100:00100000:1.0:1787582866.322073:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9575074-4197-4fbd-89bc-d0d7fb5499a5+13:2359:x1874416162150784:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582866.322080:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582866.322089:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4e9d800/0xa113d808b7537e9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fb6 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582866.322098:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582866.322118:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:2359:x1874416162150784:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 47us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582866.322124:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 18 00000100:00100000:1.0:1787582866.322136:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 19 00000100:00100000:1.0:1787582866.322142:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:2359:x1874416162150656:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582866.322149:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582866.322158:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4e9c600/0xa113d808b7537bf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57eb3 expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582866.322168:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582866.322188:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2359:x1874416162150656:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 45us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582866.322195:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 19 00000100:00100000:1.0:1787582866.331796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582866.331968:0:8218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162150912 00000100:00100000:0.0:1787582866.331991:0:8218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162150912 00000100:00100000:0.0:1787582866.332063:0:8218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 73 00000100:00100000:0.0:1787582866.332074:0:8218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+5:2356:x1874416162150912:12345-192.168.206.20@tcp:9:umount.0 00000020:00000080:0.0:1787582866.332103:0:8218:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537f62 00000100:00080000:0.0:1787582866.332113:0:8218:0:(import.c:65:import_set_state_nolock()) ffff8da58df97800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787582866.332162:0:8218:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787582866.332501:0:8218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:730f9f4f-46d8-441e-9162-5fde1074d6a5+2:2356:x1874416162150912:12345-192.168.206.20@tcp:9:umount.0 Request processed in 427us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582866.332511:0:8218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 73 00010000:00010000:1.0:1787582866.332784:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582866.340586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582866.340682:0:12082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162151296 00000100:00100000:3.0:1787582866.340697:0:12082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162151296 00000100:00100000:3.0:1787582866.340779:0:12082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 74 00000100:00100000:3.0:1787582866.340790:0:12082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2356:x1874416162151296:12345-192.168.206.20@tcp:9:umount.0 00000020:00000080:3.0:1787582866.340838:0:12082:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b75381ca 00000020:00010000:3.0:1787582866.340847:0:12082:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8da5bb7f7000: total 0 00000100:00080000:3.0:1787582866.340853:0:12082:0:(import.c:65:import_set_state_nolock()) ffff8da5bb7f1800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787582866.340904:0:12082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:2.0:1787582866.340949:0:11179:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8da5bb7f7000: total 0 00010000:00010000:2.0:1787582866.341028:0:11179:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8da5bb7f7000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787582866.341112:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e080ccaf/0xa113d808b7538566 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5818b expref: 6 pid: 12082 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582866.341176:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebb99f24/0xa113d808b7538c04 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58359 expref: 5 pid: 8218 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582866.341199:0:11179:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8da5bb7f7000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787582866.341219:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582866.341225:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582866.341229:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582866.341386:0:12082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:730f9f4f-46d8-441e-9162-5fde1074d6a5+2:2356:x1874416162151296:12345-192.168.206.20@tcp:9:umount.0 Request processed in 594us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582866.341395:0:12082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 74 00000100:00100000:2.0:1787582866.368012:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582866.368151:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162152320 00000100:00100000:1.0:1787582866.368164:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162152320 00000100:00100000:1.0:1787582866.368240:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 240 00000100:00100000:1.0:1787582866.368251:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+22:2356:x1874416162152320:12345-192.168.206.20@tcp:39:umount.0 00000020:00000080:1.0:1787582866.368295:0:5852:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537bfe 00000020:00010000:1.0:1787582866.368619:0:5852:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8da5ad764000: total 0 00000100:00080000:1.0:1787582866.368626:0:5852:0:(import.c:65:import_set_state_nolock()) ffff8da5a8c0d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787582866.368672:0:5852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1787582866.368884:0:5841:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8da5ad764000: total 0 00010000:00010000:0.0:1787582866.368950:0:5841:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8da5ad764000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787582866.368994:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:0.0:1787582866.368999:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787582866.369009:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b7538bef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58352 expref: 21 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582866.369032:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8da5a4492e00) 00010000:00010000:0.0:1787582866.369061:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787582866.369068:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4e9d600/0xa113d808b7537ec8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fc4 expref: 20 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582866.369092:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:0.0:1787582866.369095:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787582866.369098:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6000/0xa113d808b7538551 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58184 expref: 19 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582866.369112:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:0.0:1787582866.369114:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787582866.369118:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7e00/0xa113d808b75388c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58280 expref: 18 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582866.369132:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:0.0:1787582866.369134:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787582866.369137:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f600/0xa113d808b7537f38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fe0 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582866.369149:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:0.0:1787582866.369152:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787582866.369155:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b6c00/0xa113d808b7538ae5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5830c expref: 16 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582866.369168:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8da5a4492000) 00010000:00010000:0.0:1787582866.369170:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787582866.369174:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7538225 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d580b2 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582866.369202:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8da583accb00) 00010000:00010000:0.0:1787582866.369205:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787582866.369209:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b75385e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581ae expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582866.369222:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:0.0:1787582866.369224:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787582866.369227:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b7538447 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5813e expref: 13 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582866.369241:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8da5a0b68e00) 00010000:00010000:0.0:1787582866.369243:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582866.369247:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ef600/0xa113d808b7537ee4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57fcb expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582866.369264:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8da5a0b68d00) 00010000:00010000:0.0:1787582866.369267:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582866.369270:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9f400/0xa113d808b7538527 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58176 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582866.369283:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8da5a4492b00) 00010000:00010000:0.0:1787582866.369286:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582866.369290:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7000/0xa113d808b7538bc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58344 expref: 10 pid: 7653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582866.369305:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68800) 00010000:00010000:0.0:1787582866.369308:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787582866.369356:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5c20ee000/0xa113d808b75385c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d581a7 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582866.369370:0:5841:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8da5ad764000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787582866.369383:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582866.369385:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582866.369387:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582866.370172:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:730f9f4f-46d8-441e-9162-5fde1074d6a5+7:2356:x1874416162152320:12345-192.168.206.20@tcp:39:umount.0 Request processed in 1918us (2169us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787582866.370185:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 240 00000100:00100000:2.0:1787582866.512792:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186248192:0@lo:400:kworker.0 00000100:00100000:3.0:1787582866.512809:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186248320:0@lo:400:kworker.0 00000100:00100000:0.0:1787582866.512911:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186248576:0@lo:400:kworker.0 00000100:00100000:2.0:1787582866.516174:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582866.516248:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186248704:0@lo:400:kworker.0 00000100:00100000:1.0:1787582866.516287:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186248192 00000100:00100000:1.0:1787582866.516304:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186248192 00000100:00100000:2.0:1787582866.516314:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582866.516627:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186248704 00000100:00100000:2.0:1787582866.516635:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186248704 00000100:00100000:2.0:1787582866.516689:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787582866.516699:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186248704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582866.516764:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582866.516770:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186248704:12345-0@lo:400:kworker.0 Request processed in 70us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582866.516900:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186248576 00000100:00100000:0.0:1787582866.516905:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186248576 00000100:00100000:0.0:1787582866.516935:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787582866.516942:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186248576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582866.516981:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186248576:12345-0@lo:400:kworker.0 Request processed in 40us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582866.516988:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1787582866.517011:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582866.517041:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186248576:0@lo:400:kworker.0 00000100:00100000:2.0:1787582866.517227:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787582866.517261:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186248704:0@lo:400:kworker.0 00000100:00100000:2.0:1787582866.517290:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186248448:0@lo:400:kworker.0 00000100:00100000:2.0:1787582866.517754:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582866.523060:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582866.523153:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186248832:0@lo:400:kworker.0 00000100:00100000:3.0:1787582866.523264:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582866.523352:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186248448 00000100:00100000:3.0:1787582866.523362:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186248448 00000100:00100000:3.0:1787582866.523423:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186248832 00000100:00100000:3.0:1787582866.523427:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186248832 00000100:00100000:3.0:1787582866.523464:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787582866.523475:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186248448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582866.523542:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186248448:12345-0@lo:400:kworker.0 Request processed in 68us (5789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582866.523550:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787582866.523569:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787582866.523577:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186248832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582866.523611:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186248832:12345-0@lo:400:kworker.0 Request processed in 36us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582866.523617:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1787582866.523635:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787582866.523677:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186248832:0@lo:400:kworker.0 00000100:00100000:3.0:1787582866.523731:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186248320 00000100:00100000:3.0:1787582866.523735:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186248320 00000100:00100000:3.0:1787582866.523766:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787582866.523773:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186248320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582866.523837:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186248320:12345-0@lo:400:kworker.0 Request processed in 65us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582866.523844:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787582866.523875:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186248320:0@lo:400:kworker.0 00000100:00100000:2.0:1787582866.524990:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186248448:0@lo:400:kworker.0 00000100:00100000:1.0:1787582866.525033:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787582866.525048:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186248192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582866.525139:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186248192:12345-0@lo:400:kworker.0 Request processed in 95us (8970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582866.525147:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787582866.525611:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186248192:0@lo:400:kworker.0 00010000:00010000:1.0:1787582866.960566:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582867.024595:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf1ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186248960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582867.024679:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582867.024902:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186248960 00000100:00100000:3.0:1787582867.024921:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186248960 00000100:00100000:3.0:1787582867.024972:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787582867.024994:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186248960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787582867.025040:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582867.025114:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186248960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582867.025121:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787582867.025576:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf1ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186248960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787582867.613678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582867.613725:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582867.613758:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582867.613826:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582867.614105:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162152448 00000100:00100000:2.0:1787582867.614115:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162152448 00000100:00100000:2.0:1787582867.614168:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162152576 00000100:00100000:2.0:1787582867.614172:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162152576 00000100:00100000:2.0:1787582867.614183:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162152704 00000100:00100000:2.0:1787582867.614186:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162152704 00000100:00100000:2.0:1787582867.614201:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:2.0:1787582867.614210:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf1ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9575074-4197-4fbd-89bc-d0d7fb5499a5+12:2358:x1874416162152448:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582867.614223:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582867.614241:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5bb6b6800/0xa113d808b7537cd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f00 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582867.614261:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582867.614309:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf1ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9575074-4197-4fbd-89bc-d0d7fb5499a5+11:2358:x1874416162152448:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 100us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582867.614348:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:2.0:1787582867.614365:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 21 00000100:00100000:2.0:1787582867.614371:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adf79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9575074-4197-4fbd-89bc-d0d7fb5499a5+10:2360:x1874416162152576:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582867.614379:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582867.614388:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4e9ca00/0xa113d808b7537cd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57f2a expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582867.614397:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582867.614428:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adf79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9575074-4197-4fbd-89bc-d0d7fb5499a5+9:2360:x1874416162152576:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 57us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582867.614434:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 21 00000100:00100000:2.0:1787582867.614447:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 22 00000100:00100000:2.0:1787582867.614453:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9575074-4197-4fbd-89bc-d0d7fb5499a5+8:2357:x1874416162152704:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582867.614460:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582867.614469:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7537e97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57faf expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582867.614477:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582867.614495:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf879180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e9575074-4197-4fbd-89bc-d0d7fb5499a5+7:2357:x1874416162152704:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 42us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582867.614501:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 22 00000100:00100000:0.0:1787582867.616178:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162152960 00000100:00100000:0.0:1787582867.616190:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162152960 00000100:00100000:0.0:1787582867.616267:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 241 00000100:00100000:0.0:1787582867.616277:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+6:2356:x1874416162152960:12345-192.168.206.20@tcp:39:umount.0 00000020:00000080:0.0:1787582867.616311:0:7653:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537ce5 00000020:00010000:0.0:1787582867.616347:0:7653:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8da5bf45a800: total 0 00000100:00080000:0.0:1787582867.616352:0:7653:0:(import.c:65:import_set_state_nolock()) ffff8da5bf45c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787582867.616375:0:7653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1787582867.616604:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf878000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:83345526-3920-4b94-b598-4d9f74280322+5:2356:x1874416162152960:12345-192.168.206.20@tcp:39:umount.0 Request processed in 328us (2777us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787582867.616612:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 241 00000100:00080000:3.0:1787582867.616804:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1787582867.616873:0:11179:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8da5bf45a800: total 0 00010000:00010000:2.0:1787582867.616877:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582867.616915:0:11179:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8da5bf45a800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787582867.616945:0:11179:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a0b68800) 00010000:00010000:2.0:1787582867.616948:0:11179:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787582867.616956:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5bb6b7600/0xa113d808b7538c12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58360 expref: 4 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582867.616973:0:11179:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8da5bf45a800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787582867.616982:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582867.616983:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582867.616985:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582867.663471:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582867.663590:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162153216 00000100:00100000:0.0:1787582867.663600:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162153216 00000100:00100000:0.0:1787582867.663654:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 306 00000100:00100000:0.0:1787582867.663665:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+7:2356:x1874416162153216:12345-192.168.206.20@tcp:251:umount.0 00000020:00000080:0.0:1787582867.663707:0:5848:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537bdb 00000020:00010000:0.0:1787582867.663714:0:5848:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8da5a8c0c800: total 0 00000100:00080000:0.0:1787582867.663719:0:5848:0:(import.c:65:import_set_state_nolock()) ffff8da5a8c08800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787582867.663801:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9575074-4197-4fbd-89bc-d0d7fb5499a5+3:2356:x1874416162153216:12345-192.168.206.20@tcp:251:umount.0 Request processed in 138us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582867.663809:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 306 00000020:00010000:2.0:1787582867.663949:0:5841:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8da5a8c0c800: total 0 00010000:00010000:2.0:1787582867.663991:0:5841:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8da5a8c0c800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787582867.664030:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4e9c200/0xa113d808b7537c2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d57ef2 expref: 2 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582867.664067:0:5841:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8da5a8c0c800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787582867.664081:0:5841:0:(genops.c:885:class_export_put()) final put ffff8da5a8c0c800/e9575074-4197-4fbd-89bc-d0d7fb5499a5 00010000:00010000:2.0:1787582867.664090:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582867.664092:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582867.664094:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787582867.664810:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5a8c0c800/e9575074-4197-4fbd-89bc-d0d7fb5499a5 for MGS 00000020:00000080:1.0:1787582867.664850:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5a8c08800 for MGS 00010000:00010000:1.0:1787582867.986683:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582869.009140:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787582869.496980:0:12928:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787582869.518102:0:12928:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787582869.518168:0:12928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.518186:0:12928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537c75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.518195:0:12928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537c75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.518203:0:12928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537c75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.518225:0:12928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787582869.518232:0:12928:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787582869.518258:0:12928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787582869.518281:0:12928:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787582869.518288:0:12928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787582869.518345:0:12928:0:(import.c:65:import_set_state_nolock()) ffff8da5acdb5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787582869.518493:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582869.518502:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537c75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582869.518511:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581687400 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1787582869.518515:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537c75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582869.518524:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa113d808b7537c75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582869.518531:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa113d808b7537c75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582869.518536:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787582869.518539:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787582869.518543:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787582869.518579:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537c75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582869.518585:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787582869.518640:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1787582869.520127:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537c75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582869.520174:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da581687400/0xa113d808b7537c6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537c75 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582869.520197:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582869.520200:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582869.520203:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582869.520236:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874416186249088:0@lo:39:umount.0 00000100:00100000:2.0:1787582869.520755:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582869.520887:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186249088 00000100:00100000:0.0:1787582869.520897:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186249088 00000100:00100000:0.0:1787582869.520964:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787582869.520974:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874416186249088:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787582869.521011:0:5854:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b75379ea 00000100:00080000:0.0:1787582869.521021:0:5854:0:(import.c:65:import_set_state_nolock()) ffff8da5911b3000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787582869.521112:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1874416186249088:12345-0@lo:39:umount.0 Request processed in 139us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582869.521119:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1787582869.521131:0:5854:0:(genops.c:885:class_export_put()) final put ffff8da5b6073800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787582869.521421:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5b6073800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787582869.521492:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5911b3000 for lustre-MDT0000 00000100:00080000:2.0:1787582869.521535:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5acdb5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787582869.521546:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874416186249088:0@lo:39:umount.0 00000100:00080000:0.0:1787582869.521627:0:12928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787582869.521631:0:12928:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787582869.521635:0:12928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787582869.522544:0:12928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522561:0:12928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537c83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522568:0:12928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537c83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522576:0:12928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537c83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522598:0:12928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582869.522623:0:12928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537b9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522631:0:12928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537b9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522638:0:12928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537b9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522644:0:12928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537b9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522657:0:12928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787582869.522663:0:12928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537e90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522671:0:12928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537e90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522678:0:12928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537e90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522683:0:12928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537e90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522691:0:12928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787582869.522696:0:12928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5c20eea00/0xa113d808b7537949 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537950 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522703:0:12928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5c20eea00/0xa113d808b7537949 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537950 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522717:0:12928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5c20eea00/0xa113d808b7537949 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537950 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522723:0:12928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.120@tcp lock: ffff8da5c20eea00/0xa113d808b7537949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537950 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582869.522731:0:12928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1787582869.522735:0:12928:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787582869.522762:0:12928:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787582869.522766:0:12928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787582869.522771:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787582869.522777:0:12928:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1787582869.522784:0:12928:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8da5ad763800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787582869.522789:0:12928:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8da5bf3e1000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787582869.522797:0:12928:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8da5bf45a800 83345526-3920-4b94-b598-4d9f74280322 192.168.206.20@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787582869.522802:0:12928:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8da5ad764000 730f9f4f-46d8-441e-9162-5fde1074d6a5 192.168.206.20@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:0.0:1787582869.522807:0:12928:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8da5bbb84d28) has exports, disconnecting them 00000020:00080000:0.0:1787582869.522812:0:12928:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8da5ad763800), last request at 1787582866 00000020:00000080:0.0:1787582869.522818:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537b5d 00000100:00080000:0.0:1787582869.522837:0:12928:0:(import.c:65:import_set_state_nolock()) ffff8da5ad760000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787582869.522888:0:12928:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8da5ad763800): rc 0 00000020:00000080:0.0:1787582869.522891:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5ad763800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787582869.522902:0:12928:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8da5bf3e1000), last request at 1787582866 00000020:00000080:0.0:1787582869.522905:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537ad1 00000100:00080000:0.0:1787582869.522911:0:12928:0:(import.c:65:import_set_state_nolock()) ffff8da5bf3e5000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1787582869.522919:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5ad763800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1787582869.522975:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5ad760000 for lustre-MDT0000 00000020:00080000:0.0:1787582869.522989:0:12928:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8da5bf3e1000): rc 0 00000020:00000080:0.0:1787582869.522991:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5bf3e1000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787582869.523003:0:12928:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9ec64414bae0 00000020:00000080:0.0:1787582869.523016:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bf3e1000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787582869.523057:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5bf3e5000 for lustre-MDT0000 00000100:00080000:0.0:1787582869.523081:0:12928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787582869.523085:0:12928:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787582869.523098:0:12928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787582869.523169:0:12928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787582869.523193:0:12928:0:(import.c:65:import_set_state_nolock()) ffff8da5bf3e6800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787582869.523209:0:12928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787582869.523212:0:12928:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787582869.523224:0:12928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787582869.523282:0:12928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787582869.523291:0:12928:0:(import.c:65:import_set_state_nolock()) ffff8da5b6089800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787582869.523363:0:12928:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8da5bbb84d28) has no exports 00010000:00010000:2.0:1787582869.523468:0:11179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787582869.523477:0:11179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537c83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582869.523487:0:11179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9d000 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1787582869.523492:0:11179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537c83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582869.523502:0:11179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa113d808b7537c83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582869.523511:0:11179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa113d808b7537c83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582869.523518:0:11179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787582869.523528:0:11179:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1787582869.523531:0:11179:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1787582869.523561:0:11179:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537c83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582869.523568:0:11179:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787582869.523661:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186249600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787582869.523751:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787582869.523824:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1787582869.523830:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186249216:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787582869.523838:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537b9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582869.523851:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581687e00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1787582869.523856:0:5841:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537b9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582869.523869:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787582869.523882:0:5841:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa113d808b7537b9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582869.523910:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1787582869.523938:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186249600 00000100:00100000:1.0:1787582869.523946:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186249600 00000100:00100000:1.0:1787582869.523996:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186249216 00000100:00100000:1.0:1787582869.524000:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186249216 00000100:00100000:1.0:1787582869.524021:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787582869.524031:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615b3d9a-8a7c-4227-a987-f23a2209c536+20:3312:x1874416186249600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787582869.524060:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582869.524078:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da581686400/0xa113d808b7537c83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa113d808b7537c7c expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582869.524093:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582869.524129:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c59c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615b3d9a-8a7c-4227-a987-f23a2209c536+19:3312:x1874416186249600:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582869.524136:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787582869.524187:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787582869.524194:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615b3d9a-8a7c-4227-a987-f23a2209c536+18:3312:x1874416186249216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787582869.524202:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582869.524210:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da580031600/0xa113d808b7537c75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa113d808b7537c6e expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582869.524220:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582869.524243:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615b3d9a-8a7c-4227-a987-f23a2209c536+17:3312:x1874416186249216:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582869.524249:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787582869.524678:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186249600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787582869.524703:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186249216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787582869.524780:0:12929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582869.524788:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537e90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582869.524795:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9de00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1787582869.524799:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537e90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582869.524808:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa113d808b7537e90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582869.524815:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa113d808b7537e90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582869.524821:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787582869.524823:0:5842:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787582869.524826:0:5842:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787582869.524846:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537e90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582869.524851:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582869.524872:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537e90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582869.524877:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9de00/0xa113d808b7537e89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537e90 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582869.524887:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582869.524888:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582869.524895:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582869.524907:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186249728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787582869.524936:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582869.524962:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186249728 00000100:00100000:1.0:1787582869.524966:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186249728 00000100:00100000:1.0:1787582869.524987:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787582869.524993:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615b3d9a-8a7c-4227-a987-f23a2209c536+17:3313:x1874416186249728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787582869.525001:0:8463:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582869.525010:0:8463:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5a08d1a00/0xa113d808b7537e90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa113d808b7537e89 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582869.525019:0:8463:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582869.525054:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:615b3d9a-8a7c-4227-a987-f23a2209c536+16:3313:x1874416186249728:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582869.525059:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787582869.525085:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186249728:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1787582869.525129:0:5841:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa113d808b7537b9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582869.525142:0:5841:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787582869.525145:0:5841:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787582869.525174:0:5841:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787582869.525218:0:5841:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537b9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582869.525226:0:5841:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582869.525257:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537b9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582869.525266:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da581687e00/0xa113d808b7537b95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537b9c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582869.525287:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582869.525290:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582869.525293:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582869.525386:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186249344:0@lo:9:umount.0 00000100:00100000:3.0:1787582869.525457:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582869.525494:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186249344 00000100:00100000:0.0:1787582869.525499:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186249344 00000100:00100000:3.0:1787582869.525506:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186249472:0@lo:9:umount.0 00000100:00100000:3.0:1787582869.525537:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582869.525632:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582869.525645:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bf879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186249856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787582869.525679:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582869.525733:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186249856 00000100:00100000:1.0:1787582869.525737:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186249856 00000100:00100000:1.0:1787582869.525763:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787582869.525770:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+16:3313:x1874416186249856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787582869.525779:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582869.525791:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da58147e200/0xa113d808b7537b9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa113d808b7537b95 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582869.525818:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582869.525846:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:615b3d9a-8a7c-4227-a987-f23a2209c536+15:3313:x1874416186249856:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582869.525851:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787582869.525880:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bf879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186249856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787582869.526275:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186249472 00000100:00100000:0.0:1787582869.526280:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186249472 00000100:00100000:0.0:1787582869.526342:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787582869.526352:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874416186249344:12345-0@lo:9:umount.0 00000100:00100000:3.0:1787582869.528472:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787582869.528497:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874416186249472:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787582869.528526:0:6704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537bc6 00000100:00080000:3.0:1787582869.528536:0:6704:0:(import.c:65:import_set_state_nolock()) ffff8da5b62ad800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787582869.528575:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000020:00000080:0.0:1787582869.528648:0:6705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537adf 00000100:00080000:0.0:1787582869.528666:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8da5aefaf800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787582869.528725:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1787582869.529071:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3310:x1874416186249344:12345-0@lo:9:umount.0 Request processed in 2718us (3615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582869.529082:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787582869.529264:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3310:x1874416186249472:12345-0@lo:9:umount.0 Request processed in 776us (3724us total) trans 0 rc 0/0 00010000:00010000:1.0:1787582869.529401:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582869.529479:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1787582869.529509:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787582869.529516:0:5849:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787582869.529532:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582869.529549:0:12930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582869.529553:0:12930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582869.529556:0:12930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787582869.529584:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5bf3e6800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787582869.529601:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787582869.529603:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787582869.529607:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186249344:0@lo:9:umount.0 00000100:00080000:0.0:1787582869.529621:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5b6089800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787582869.529631:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787582869.529632:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787582869.529635:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad930700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186249472:0@lo:9:umount.0 00010000:00010000:1.0:1787582869.529904:0:12929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5c20eea00/0xa113d808b7537949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537950 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582869.529916:0:12929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20eea00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1787582869.529920:0:12929:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5c20eea00/0xa113d808b7537949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537950 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582869.529934:0:12929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5c20eea00/0xa113d808b7537949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa113d808b7537950 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582869.529941:0:12929:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5c20eea00/0xa113d808b7537949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa113d808b7537950 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582869.529946:0:12929:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787582869.529949:0:12929:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787582869.529952:0:12929:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787582869.529993:0:12929:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5c20eea00/0xa113d808b7537949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537950 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582869.529999:0:12929:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787582869.530022:0:12929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5c20eea00/0xa113d808b7537949 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537950 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582869.530050:0:12929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5c20eea00/0xa113d808b7537949 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537950 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582869.530078:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582869.530099:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186249984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787582869.530157:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787582869.530191:0:11179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537c83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582869.530200:0:11179:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d000/0xa113d808b7537c7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537c83 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582869.530207:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186249984 00000100:00100000:1.0:1787582869.530223:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186249984 00000100:00100000:1.0:1787582869.530442:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787582869.530453:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+15:3312:x1874416186249984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787582869.530469:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582869.530486:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da581686000/0xa113d808b7537950 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa113d808b7537949 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582869.530502:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787582869.530533:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:615b3d9a-8a7c-4227-a987-f23a2209c536+14:3312:x1874416186249984:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582869.530539:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787582869.530573:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:615b3d9a-8a7c-4227-a987-f23a2209c536:3312:1874416186249984:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787582869.530586:0:12929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582869.530588:0:12929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582869.530590:0:12929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582869.531018:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582869.531021:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582869.531023:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787582869.535662:0:12928:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8da5bbb84d28) has no exports 00000020:00000080:0.0:1787582869.624607:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b75379a4 00000020:00000080:0.0:1787582869.624622:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da586ed8800/lustre-QMT0000_UUID 00000020:01000000:0.0:1787582869.624639:0:12928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787582869.625030:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da586ed8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787582869.625791:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787582869.625802:0:12928:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787582869.625807:0:12928:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8da5b606b370) has no exports 00000020:00000080:3.0:1787582869.631716:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b753799d 00000020:00000080:3.0:1787582869.631727:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5b6075000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787582869.631744:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5b6075000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787582869.631789:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787582869.631808:0:12928:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787582869.631811:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5b6075800/lustre-QMT0000_UUID 00000020:00000080:3.0:1787582869.631813:0:12928:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5b6075800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787582869.631817:0:12928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:0.0:1787582869.641881:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 83345526-3920-4b94-b598-4d9f74280322 00000001:00080000:0.0:1787582869.641899:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1787582869.641903:0:5876:0:(genops.c:885:class_export_put()) final put ffff8da5bf45a800/83345526-3920-4b94-b598-4d9f74280322 00000001:00080000:0.0:1787582869.641916:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:0.0:1787582869.641924:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 730f9f4f-46d8-441e-9162-5fde1074d6a5 00000001:00080000:0.0:1787582869.641929:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1787582869.641938:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bf45a800/83345526-3920-4b94-b598-4d9f74280322 for lustre-MDT0000 00000020:00000080:0.0:1787582869.641939:0:5876:0:(genops.c:885:class_export_put()) final put ffff8da5ad764000/730f9f4f-46d8-441e-9162-5fde1074d6a5 00000020:00000080:3.0:1787582869.641978:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5ad764000/730f9f4f-46d8-441e-9162-5fde1074d6a5 for lustre-MDT0000 00000020:00000080:3.0:1787582869.642020:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5bf45c800 for lustre-MDT0000 00000020:00000080:3.0:1787582869.642025:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5a8c0d000 for lustre-MDT0000 00000001:00100000:1.0:1787582869.643290:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 730f9f4f-46d8-441e-9162-5fde1074d6a5 00000020:00000080:1.0:1787582869.643295:0:7656:0:(genops.c:885:class_export_put()) final put ffff8da590711800/730f9f4f-46d8-441e-9162-5fde1074d6a5 00000001:00100000:1.0:1787582869.643312:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787582869.643333:0:7656:0:(genops.c:885:class_export_put()) final put ffff8da5b62aa800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787582869.643692:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787582869.643696:0:6733:0:(genops.c:885:class_export_put()) final put ffff8da5aefaf000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787582869.643709:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 730f9f4f-46d8-441e-9162-5fde1074d6a5 00000020:00000080:2.0:1787582869.643712:0:6733:0:(genops.c:885:class_export_put()) final put ffff8da5bb7f7000/730f9f4f-46d8-441e-9162-5fde1074d6a5 00000020:00000080:2.0:1787582869.644735:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da590711800/730f9f4f-46d8-441e-9162-5fde1074d6a5 for lustre-OST0001 00000020:00000080:2.0:1787582869.644779:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5b62aa800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787582869.644794:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5aefaf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787582869.644812:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bb7f7000/730f9f4f-46d8-441e-9162-5fde1074d6a5 for lustre-OST0000 00000020:00000080:2.0:1787582869.644828:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da58df97800 for lustre-OST0001 00000020:00000080:2.0:1787582869.644832:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5b62ad800 for lustre-OST0001 00000020:00000080:2.0:1787582869.644835:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5aefaf800 for lustre-OST0000 00000020:00000080:2.0:1787582869.644839:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5bb7f1800 for lustre-OST0000 00010000:00010000:1.0:1787582870.035465:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582871.056583:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582871.633251:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787582871.633273:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186250112:0@lo:400:kworker.0 00000100:00100000:3.0:1787582871.633276:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874416186250368:0@lo:400:kworker.0 00000100:00100000:1.0:1787582871.633454:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186250240:0@lo:400:kworker.0 00000020:01000000:2.0:1787582871.635586:0:12928:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8da585274300 - data ffff8da5bfe7dd80/ffff8da5bb4fec00 00000020:01000000:2.0:1787582871.635738:0:12928:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8da589dabd20 - data ffff8da59f3d21b0/ffff8da5885bd400 00000100:00100000:0.0:1787582871.636662:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582871.636940:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186250112 00000100:00100000:2.0:1787582871.636959:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186250112 00000100:00100000:2.0:1787582871.637012:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787582871.637031:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+14:3311:x1874416186250112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582871.637086:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589dbdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:615b3d9a-8a7c-4227-a987-f23a2209c536+14:3311:x1874416186250112:12345-0@lo:400:kworker.0 Request processed in 65us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582871.637093:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1787582871.637370:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186250112:0@lo:400:kworker.0 00000100:00100000:3.0:1787582871.637708:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582871.637765:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186250368 00000100:00100000:0.0:1787582871.637770:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186250368 00000100:00100000:0.0:1787582871.637817:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787582871.637822:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1874416186250368:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787582871.637828:0:5855:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787582871.637877:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1874416186250368:12345-0@lo:400:kworker.0 Request processed in 53us (169us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787582871.637883:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1787582871.638250:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787582871.638255:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8da58df1e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787582871.638259:0:3314:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787582871.641525:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582871.649343:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186250240 00000100:00100000:0.0:1787582871.649357:0:12083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186250240 00000100:00100000:0.0:1787582871.649413:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787582871.649422:0:12083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3313:x1874416186250240:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787582871.649431:0:12083:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787582871.649506:0:12083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3313:x1874416186250240:12345-0@lo:400:kworker.0 Request processed in 83us (7987us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787582871.649513:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1787582871.649636:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787582871.649641:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8da5bbba3800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787582871.649644:0:3313:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787582871.649649:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8da5bbba3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787582871.649653:0:3313:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 196 00000100:00080000:1.0:1787582871.649658:0:3313:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8da5bbba3800 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:1.0:1787582871.649685:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da482a9aa00 x1874416186250496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787582871.649716:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186250240:0@lo:400:kworker.0 00000100:00100000:0.0:1787582871.651529:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874416186250496:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787582871.651592:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582871.651682:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186250496 00000100:00100000:1.0:1787582871.651690:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186250496 00000100:00100000:1.0:1787582871.651727:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787582871.651734:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874416186250496:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1787582871.651750:0:5852:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1787582871.653660:0:3314:0:(import.c:65:import_set_state_nolock()) ffff8da58df1e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787582871.653669:0:3314:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 215 00000100:00080000:3.0:1787582871.653677:0:3314:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8da58df1e000 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:3.0:1787582871.653716:0:3314:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5ad9ae680 x1874416186250624/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787582871.653739:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874416186250368:0@lo:400:kworker.0 00000100:00100000:0.0:1787582871.653831:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874416186250624:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1787582871.653894:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582871.654182:0:7653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186250624 00000100:00100000:3.0:1787582871.654189:0:7653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186250624 00000100:00100000:3.0:1787582871.654226:0:7653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787582871.654233:0:7653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1874416186250624:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1787582871.654248:0:7653:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787582871.654291:0:7653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1874416186250624:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 56us (395us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787582871.654298:0:7653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1787582871.654775:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da58df1e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787582871.654781:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787582871.654785:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874416186250624:0@lo:38:ptlrpcd_00_03.0 00000001:00000004:2.0:1787582871.657717:0:12928:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1787582871.666699:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874416186250496:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 14956us (15098us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787582871.666712:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1787582871.666906:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5bbba3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787582871.666912:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787582871.666916:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874416186250496:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1787582871.771306:0:12928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787582871.771349:0:12928:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787582871.771761:0:12928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787582871.771765:0:12928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787582871.772923:0:6720:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787582871.772930:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1787582871.773070:0:6720:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787582871.777083:0:12928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787582871.777187:0:12928:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1787582871.777250:0:12928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787582871.777253:0:12928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787582871.778778:0:8040:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787582871.778785:0:8040:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787582871.778795:0:8040:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787582871.894215:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b753796c 00000020:00000080:3.0:1787582871.894296:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5bbb7e000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787582871.895934:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537981 00000020:00000080:3.0:1787582871.895944:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5bbba1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787582871.896195:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bbb7e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787582871.896351:0:12928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787582871.896359:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787582871.896367:0:12928:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787582871.896371:0:12928:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8da5bbb80000) has no exports 00000004:01000000:3.0:1787582871.896741:0:12928:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787582871.896750:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537bbf 00000020:00000080:3.0:1787582871.896754:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5a8c0e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787582871.896790:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bbba1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787582871.896823:0:12928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787582871.896828:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787582871.896834:0:12928:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787582871.896837:0:12928:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8da5bf2d8000) has no exports 00000020:00000080:3.0:1787582871.896851:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537bb8 00000020:00000080:3.0:1787582871.896856:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5b608f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787582871.897085:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5a8c0e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787582871.897092:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5b608f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787582871.897588:0:12928:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787582871.897593:0:12928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787582871.897597:0:12928:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1787582871.897602:0:12928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787582871.897604:0:12928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787582871.897732:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787582871.897741:0:12928:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787582871.897747:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537a76 00000020:00000080:3.0:1787582871.897752:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5bf45e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787582871.897771:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5b6089800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787582871.897776:0:8:0:(genops.c:885:class_export_put()) final put ffff8da5b608e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787582871.897778:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5b608e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787582871.897782:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787582871.897879:0:12928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787582871.897884:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787582871.897888:0:12928:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787582871.897891:0:12928:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8da5bbb819b8) has no exports 00000020:00000080:3.0:1787582871.897895:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537a45 00000020:00000080:3.0:1787582871.897899:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5bf3e4000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787582871.898121:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bf45e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787582871.898128:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bf3e4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787582871.898605:0:12928:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787582871.898609:0:12928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787582871.898611:0:12928:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1787582871.898615:0:12928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787582871.898617:0:12928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787582871.898752:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787582871.898758:0:12928:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787582871.898787:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787582871.898790:0:12928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787582871.898794:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5bbb79800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787582871.898796:0:12928:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bbb79800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787582871.898802:0:12928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787582871.898926:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537988 00000020:00000080:3.0:1787582871.898931:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5bbba7000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787582871.899092:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5bf3e6800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787582871.899099:0:8:0:(genops.c:885:class_export_put()) final put ffff8da59102b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787582871.899101:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da59102b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787582871.899106:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787582871.899529:0:12928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787582871.899534:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787582871.899539:0:12928:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787582871.899543:0:12928:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8da5bbb83370) has no exports 00000020:00000080:3.0:1787582871.899563:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787582871.899567:0:12928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787582871.899570:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b753798f 00000020:00000080:3.0:1787582871.899574:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5bbba0000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787582871.899600:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bbba7000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1787582871.899604:0:8:0:(genops.c:885:class_export_put()) final put ffff8da5bbb7b000/lustre-MDD0000_UUID 00000020:00000080:0.0:1787582871.899606:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bbb7b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1787582871.899611:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1787582871.899864:0:12928:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8da584c3b800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787582871.899868:0:12928:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8da584c3b800 3 00000020:01000004:3.0:1787582871.899871:0:12928:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8da584c3b800 from lustre-MDT0000 00000020:00000080:3.0:1787582871.899892:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787582871.899896:0:12928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787582871.899899:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5bbb7f800/lustre-MDT0000_UUID 00000020:00000080:3.0:1787582871.899901:0:12928:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bbb7f800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787582871.899908:0:12928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787582871.899937:0:12928:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1787582871.899940:0:12928:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787582871.899944:0:12928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787582871.899947:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787582871.899960:0:12928:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787582871.899966:0:12928:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8da585081800 615b3d9a-8a7c-4227-a987-f23a2209c536 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787582871.899972:0:12928:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8da5885919b8) has exports, disconnecting them 00000020:00080000:3.0:1787582871.899977:0:12928:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8da585081800), last request at 1787582638 00000020:00000080:3.0:1787582871.899990:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b753792d 00000020:00010000:3.0:1787582871.900002:0:12928:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8da585081800: total 1 00000100:00080000:3.0:1787582871.900007:0:12928:0:(import.c:65:import_set_state_nolock()) ffff8da585080000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787582871.900031:0:12928:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8da585081800): rc 0 00000020:00080000:3.0:1787582871.900035:0:12928:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8da5885919b8) has no exports 00000020:00010000:1.0:1787582871.900102:0:12930:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8da585081800: total 1 00010000:00010000:1.0:1787582871.900132:0:12930:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8da585081800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787582871.900158:0:12930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da581687a00/0xa113d808b7537c91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa113d808b7537c8a expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582871.900174:0:12930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da58147e400/0xa113d808b7537a61 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa113d808b7537a5a expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582871.900197:0:12930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4e9c400/0xa113d808b7537c3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa113d808b7537c36 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582871.900207:0:12930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4e9cc00/0xa113d808b7537c4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa113d808b7537c44 expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582871.900217:0:12930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da580031800/0xa113d808b7537e74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa113d808b7537e6d expref: 5 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582871.900239:0:12930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da580030a00/0xa113d808b7537c59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa113d808b7537c52 expref: 4 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582871.900248:0:12930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da581686800/0xa113d808b7537c67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa113d808b7537c60 expref: 3 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582871.900261:0:12930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4e9d400/0xa113d808b7537e82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa113d808b7537e7b expref: 2 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582871.900271:0:12930:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8da585081800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787582871.900283:0:12930:0:(genops.c:885:class_export_put()) final put ffff8da585081800/615b3d9a-8a7c-4227-a987-f23a2209c536 00000100:00100000:3.0:1787582871.900342:0:5847:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8da589d7c600:5847] 1 exiting: rc = 0 00000020:00000080:0.0:1787582871.900814:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bbba0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1787582871.900842:0:5848:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8da589d7cc00:5848] 2 exiting: rc = 0 00010000:00010000:1.0:1787582871.901071:0:12930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582871.901074:0:12930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582871.901077:0:12930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787582871.901099:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da585081800/615b3d9a-8a7c-4227-a987-f23a2209c536 for MGS 00000020:00000080:0.0:1787582871.901189:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da585080000 for MGS 00000100:00100000:3.0:1787582871.901472:0:5846:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8da589d7d400:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1787582871.901569:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901590:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901596:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901603:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901610:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901616:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901763:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901770:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901776:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901781:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901788:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901793:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901799:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901804:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901809:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901815:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901820:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901826:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901831:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901836:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901842:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901847:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901852:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901857:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901863:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901869:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901875:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901880:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901885:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901890:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901894:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901900:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901905:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901910:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901915:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.901920:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902173:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902179:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902184:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902190:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902195:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902200:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902206:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902211:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902217:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902298:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902304:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902310:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902901:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902912:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902918:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902934:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902941:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.902946:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.903115:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.903125:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.903130:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.903135:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.903141:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.903146:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.903151:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.903157:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.903163:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582871.903169:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1787582871.903865:0:12928:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787582871.903869:0:12928:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1787582871.905202:0:12928:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8da585274ae0 - data ffff8da5bfe7d6c0/ffff8da5bb4fc000 00000020:01000000:0.0:1787582871.905548:0:12928:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8da58de24c60 - data ffff8da59f3d3ca8/ffff8da58714d000 00000020:00000080:0.0:1787582871.909515:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537911 00000020:00000080:0.0:1787582871.909523:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da589ee3800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787582871.909541:0:12928:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8da584c3b800 from MGS, refs=2 00000020:01000004:0.0:1787582871.909554:0:12928:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8da584c3b800 2 00000020:01000004:0.0:1787582871.909557:0:12928:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8da584c3b800 from MGS 00000020:00000080:0.0:1787582871.909575:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787582871.909582:0:12928:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787582871.909585:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da585e3c000/MGS 00000020:00000080:0.0:1787582871.909587:0:12928:0:(genops.c:844:class_export_destroy()) destroying export ffff8da585e3c000/MGS for MGS 00000020:01000000:0.0:1787582871.909594:0:12928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787582871.909662:0:12928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787582871.909667:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787582871.909672:0:12928:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787582871.909679:0:12928:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8da5acdb4800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787582871.909684:0:12928:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8da5b5023370) has exports, disconnecting them 00000020:00080000:0.0:1787582871.909688:0:12928:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8da5acdb4800), last request at 1787582639 00000020:00000080:0.0:1787582871.909692:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b75379dc 00000020:00080000:0.0:1787582871.909702:0:12928:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8da5acdb4800): rc 0 00000020:00000080:0.0:1787582871.909705:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5acdb4800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787582871.910258:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da589ee3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787582871.910276:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5acdb4800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787582871.921479:0:12928:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787582871.921487:0:12928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787582871.921492:0:12928:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787582871.921499:0:12928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787582871.921765:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787582871.921773:0:12928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787582871.921780:0:12928:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8da584c3b800 1 00000020:00000080:0.0:1787582871.921786:0:12928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537903 00000020:00000080:0.0:1787582871.921794:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da5898be000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787582871.921880:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5acdb5800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787582871.921887:0:8:0:(genops.c:885:class_export_put()) final put ffff8da586ede800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787582871.921889:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da586ede800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787582871.921899:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1787582871.922123:0:12928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787582871.922129:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787582871.922133:0:12928:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787582871.922137:0:12928:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8da588593370) has no exports 00000020:00000080:1.0:1787582871.922247:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5898be000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787582872.061714:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787582872.061728:0:12928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787582872.061733:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da584c3f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787582872.061746:0:12928:0:(genops.c:844:class_export_destroy()) destroying export ffff8da584c3f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787582872.061752:0:12928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787582872.061872:0:12928:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8da584c39800 00000020:01000000:0.0:1787582872.061891:0:12928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787582872.061895:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787582872.061899:0:12928:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787582872.061902:0:12928:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8da588594d28) has no exports 00000100:00100000:0.0:1787582872.061990:0:5854:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8da5850b2000:5854] 1 exiting: rc = 0 00000100:00100000:0.0:1787582872.062095:0:5855:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8da5850b2e00:5855] 2 exiting: rc = 0 00000100:00100000:0.0:1787582872.062144:0:12083:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8da5bf2fd200:12083] 4 exiting: rc = 0 00000100:00100000:0.0:1787582872.066042:0:5852:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8da589208c00:5852] 0 exiting: rc = 1 00000100:00100000:3.0:1787582872.072182:0:7653:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8da5bba8c800:7653] 3 exiting: rc = 0 00000100:00100000:1.0:1787582872.076665:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076692:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076698:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076704:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076709:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076715:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076720:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076724:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076730:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076735:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076740:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076745:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076750:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076756:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076761:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076766:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076771:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076776:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076781:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076786:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076794:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076800:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076805:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076810:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076816:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076822:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076827:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076832:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076837:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076843:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076862:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076868:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076873:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076878:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076884:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076889:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076903:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076909:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076914:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076920:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076926:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076932:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076938:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076956:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076963:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076969:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076975:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076979:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076984:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.076989:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.077005:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.077014:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.077028:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.077035:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.077040:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.077045:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.077051:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.077056:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.077062:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.077067:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.077072:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.077079:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.077084:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.077090:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.089922:0:11490:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8da5ad8bd200:11490] 2 exiting: rc = 0 00000100:00100000:0.0:1787582872.090070:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8da5a08b5000:5856] 0 exiting: rc = 1 00000100:00100000:3.0:1787582872.090177:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8da587149c00:5857] 1 exiting: rc = 0 00000100:00100000:1.0:1787582872.092346:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092359:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092366:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092371:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092376:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092382:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092387:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092424:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092429:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092435:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092442:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092448:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092456:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092461:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092466:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092471:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092475:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092480:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092485:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092490:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092495:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092500:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092506:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092511:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092516:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092521:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092527:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092531:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092536:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092542:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092547:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092551:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092557:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092562:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092567:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092572:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092576:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092581:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092586:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092592:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092597:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092602:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092614:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092628:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092634:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092639:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092644:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092649:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092654:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092658:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092664:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092669:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092675:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092680:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092685:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092690:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092695:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092700:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092704:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092708:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092713:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092718:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092723:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.092728:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787582872.102308:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8da587148a00:5859] 1 exiting: rc = 0 00000100:00100000:0.0:1787582872.103620:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8da5850b3800:5858] 0 exiting: rc = 1 00000100:00100000:1.0:1787582872.103778:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103789:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103797:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103804:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103812:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103820:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103864:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103874:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103882:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103890:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103898:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103906:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103913:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103938:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103960:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103966:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103972:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.103977:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104013:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104028:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104034:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104040:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104046:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104052:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104057:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104062:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104069:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104074:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104080:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104085:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104105:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104111:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104117:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104122:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104129:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104139:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104145:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104152:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104158:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104165:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104171:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104176:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104197:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104204:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104209:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104216:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104234:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104241:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104253:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104259:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104273:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104279:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104285:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104290:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104349:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104356:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104362:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104368:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104376:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104382:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104387:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104394:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104408:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.104430:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787582872.129864:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8da587149600:5861] 1 exiting: rc = 0 00000100:00100000:1.0:1787582872.132142:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8da587149200:5860] 0 exiting: rc = 1 00000100:00100000:0.0:1787582872.132390:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132397:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132402:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132406:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132411:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132417:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132421:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132426:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132431:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132436:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132441:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132446:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132451:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132456:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132461:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132467:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132472:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132478:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132483:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132498:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132503:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132508:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132514:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132518:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132522:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132527:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132533:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132538:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132542:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132548:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132553:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132557:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132562:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132567:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132572:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132577:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132582:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132587:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132592:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132597:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132603:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132608:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132613:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132618:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132623:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132628:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132633:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132638:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132642:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132647:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132653:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132658:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132663:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.132668:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.133222:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.133228:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.133234:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.133241:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.133246:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.133253:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.133259:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.133266:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.133272:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.133280:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.134744:0:5862:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8da587149400:5862] 0 exiting: rc = 1 00000100:00100000:3.0:1787582872.143700:0:5863:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8da587148600:5863] 1 exiting: rc = 0 00000100:00100000:0.0:1787582872.143911:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.143919:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.143924:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.143929:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.143935:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.143940:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146598:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146610:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146626:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146632:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146636:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146640:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146644:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146649:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146653:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146658:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146662:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146667:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146672:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146677:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146682:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146687:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146692:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146697:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146703:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146723:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146728:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146732:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146737:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146742:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146747:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146752:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146757:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146761:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146768:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146772:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146776:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146781:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146786:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146791:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146796:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146801:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146806:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146811:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146816:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146821:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146827:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146831:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146836:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146841:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146857:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146861:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146865:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146870:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146874:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146878:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146882:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146886:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.146891:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.151370:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.151411:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.151419:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.151426:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.151433:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.159691:0:5864:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8da58920f400:5864] 0 exiting: rc = 1 00000100:00100000:3.0:1787582872.166240:0:5865:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8da58920de00:5865] 1 exiting: rc = 0 00000100:00100000:1.0:1787582872.166750:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166762:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166767:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166772:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166777:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166782:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166788:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166792:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166797:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166802:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166807:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166812:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166816:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166821:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166826:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166831:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166858:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166864:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166869:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166874:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166878:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166883:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166888:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166892:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166896:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166901:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166907:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166912:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166916:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166921:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166925:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166929:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166934:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166939:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166971:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166977:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166981:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.166986:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167098:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167108:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167113:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167118:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167125:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167130:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167135:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167140:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167146:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167232:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167238:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167243:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167248:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167261:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167389:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167396:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167493:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167499:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167639:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167646:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167651:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167655:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167660:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167664:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167669:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.167674:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582872.169279:0:5866:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8da58509ce00:5866] 0 exiting: rc = 1 00000100:00100000:0.0:1787582872.169860:0:5867:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8da58509c800:5867] 1 exiting: rc = 0 00000100:00100000:0.0:1787582872.170030:0:5868:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8da58509d800:5868] 2 exiting: rc = 0 00000100:00100000:0.0:1787582872.170087:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170095:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170100:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170106:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170111:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170116:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170121:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170126:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170131:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170136:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170141:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170147:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170152:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170160:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170165:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170170:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170189:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170196:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170201:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170206:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170212:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170217:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170223:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170229:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170236:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170244:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170251:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170259:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170877:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170905:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170916:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170922:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170928:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170935:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170954:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170961:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170969:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170975:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170981:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.170987:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171039:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171046:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171052:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171058:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171063:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171070:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171075:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171081:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171088:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171094:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171100:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171106:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171112:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171118:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171123:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171129:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171135:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171140:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171145:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171150:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171155:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171160:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171166:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582872.171171:0:12928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1787582872.190937:0:12929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787582872.192538:0:12928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787582872.192551:0:12928:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787582872.192556:0:12928:0:(genops.c:885:class_export_put()) final put ffff8da59102a800/MDS_uuid 00000020:00000080:1.0:1787582872.192561:0:12928:0:(genops.c:844:class_export_destroy()) destroying export ffff8da59102a800/MDS_uuid for MDS 00000020:01000000:1.0:1787582872.192567:0:12928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787582872.194732:0:12928:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787582873.233728:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582874.256668:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582875.285353:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787582875.570032:0:13086:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787582875.630379:0:13086:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787582875.630423:0:13086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582875.630436:0:13086:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537c59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582875.630444:0:13086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537c59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582875.630452:0:13086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537c59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582875.630471:0:13086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787582875.630476:0:13086:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787582875.630495:0:13086:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787582875.630499:0:13086:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787582875.630505:0:13086:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787582875.630511:0:13086:0:(import.c:65:import_set_state_nolock()) ffff8da5bbba3800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787582875.630528:0:13086:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787582875.630529:0:13086:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787582875.630546:0:13086:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787582875.631379:0:13086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582875.631392:0:13086:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537c67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582875.631398:0:13086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537c67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582875.631404:0:13086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537c67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582875.631418:0:13086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787582875.631424:0:13086:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582875.631430:0:13086:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582875.631436:0:13086:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582875.631440:0:13086:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582875.631448:0:13086:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1787582875.631451:0:13086:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787582875.631466:0:13086:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787582875.631470:0:13086:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787582875.631473:0:13086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787582875.631484:0:13086:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787582875.631488:0:13086:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8da5b60699b8) has no exports 00000020:00080000:3.0:1787582875.631507:0:13086:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8da5b60699b8) has no exports 00000020:01000000:3.0:1787582875.633042:0:13086:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8da4822abea0 - data ffff8da5bfcd0438/ffff8da5bb597400 00010000:00010000:0.0:1787582875.633368:0:12930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787582875.633377:0:12930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537c59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582875.633388:0:12930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1200 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582875.633392:0:12930:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537c59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582875.633401:0:12930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa113d808b7537c59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582875.633409:0:12930:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa113d808b7537c59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582875.633414:0:12930:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787582875.633417:0:12930:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787582875.633421:0:12930:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787582875.633457:0:12930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537c59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582875.633464:0:12930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582875.633485:0:12930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537c59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582875.633492:0:12930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7537c52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537c59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582875.633504:0:12930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787582875.633507:0:12930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537c67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582875.633542:0:12930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580030200 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582875.633545:0:12930:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537c67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582875.633552:0:12930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa113d808b7537c67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582875.633559:0:12930:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa113d808b7537c67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582875.633563:0:12930:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787582875.633565:0:12930:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787582875.633567:0:12930:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787582875.633582:0:12930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537c67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582875.633588:0:12930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582875.633593:0:12930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537c67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582875.633600:0:12930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da580030200/0xa113d808b7537c60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537c67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582875.633609:0:12930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582875.633612:0:12930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582875.633618:0:12930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7800 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:0.0:1787582875.633620:0:12930:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582875.633632:0:12930:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa113d808b7537e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582875.633639:0:12930:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa113d808b7537e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582875.633643:0:12930:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787582875.633645:0:12930:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787582875.633647:0:12930:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787582875.633660:0:12930:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582875.633665:0:12930:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787582875.633688:0:12930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582875.633695:0:12930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7800/0xa113d808b7537e7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa113d808b7537e82 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582875.633705:0:12930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582875.633706:0:12930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582875.633708:0:12930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582875.633724:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186250752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787582875.633783:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582875.633841:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787582875.633848:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186250880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787582875.633868:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582875.633894:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186251008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787582875.633926:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582875.633970:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186250752 00000100:00100000:0.0:1787582875.633977:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186250752 00000100:00100000:0.0:1787582875.634024:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186250880 00000100:00100000:0.0:1787582875.634028:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186250880 00000100:00100000:0.0:1787582875.634038:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186251008 00000100:00100000:0.0:1787582875.634040:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186251008 00000100:00100000:0.0:1787582875.634051:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787582875.634058:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad933800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3311:x1874416186250752:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787582875.634064:0:5840:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787582875 with bad export cookie 11606858196610939181 00010000:00010000:2.0:1787582875.636195:0:12929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582875.636207:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582875.636340:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787582875.636351:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad931f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1874416186250880:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787582875.636359:0:5838:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787582875 with bad export cookie 11606858196610939181 00000100:00100000:1.0:1787582875.636445:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad931f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1874416186250880:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (2576us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787582875.636453:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787582875.636477:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787582875.636481:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c58850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1874416186251008:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787582875.636485:0:5838:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787582875 with bad export cookie 11606858196610939181 00000100:00080000:2.0:1787582875.636632:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787582875.636636:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8da59102f000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787582875.636640:0:3311:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.120@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1787582875.636667:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c58850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3313:x1874416186251008:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (2588us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787582875.636690:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787582875.636745:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.120@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:01000000:3.0:1787582875.636872:0:13086:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8da5b62b3b40 - data ffff8da59f334af8/ffff8da5bf740400 00000100:00100000:0.0:1787582875.652442:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad933800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3311:x1874416186250752:12345-0@lo:103:ldlm_bl.0 Request processed in 18379us (18655us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787582875.652455:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1787582875.677348:0:3311:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.120@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787582875.677353:0:3311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787582875.677362:0:3311:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8da5ad932680 x1874416186250752/t0(0) o103->MGC192.168.206.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787582891 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582875.677376:0:3311:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8da5ad933b80 x1874416186250880/t0(0) o103->MGC192.168.206.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787582891 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582875.677384:0:3311:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8da5ad933480 x1874416186251008/t0(0) o103->MGC192.168.206.120@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787582891 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787582875.677422:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8da59102f000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1787582875.677525:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:615b3d9a-8a7c-4227-a987-f23a2209c536:3313:1874416186251008:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1787582875.677740:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787582875.677743:0:3311:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787582875.677744:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787582875.677748:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8da59102f000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787582875.677752:0:3311:0:(import.c:510:import_select_connection()) MGC192.168.206.120@tcp: connect to NID 0@lo last attempt 179 00000100:00080000:2.0:1787582875.677775:0:3311:0:(import.c:624:import_select_connection()) MGC192.168.206.120@tcp: import ffff8da59102f000 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:3.0:1787582875.678074:0:3311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5ad9afb80 x1874416186251136/t0(0) o250->MGC192.168.206.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787582875.678118:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186250752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787582875.678132:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad933b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:615b3d9a-8a7c-4227-a987-f23a2209c536:3311:1874416186250880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787582875.678185:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:615b3d9a-8a7c-4227-a987-f23a2209c536:3310:1874416186251136:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1787582875.678228:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874416186251136 offset 0 length 520: 4 00100000:10000000:2.0:1787582875.694617:0:13086:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787582875.754040:0:13086:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537a92 00000020:00000080:0.0:1787582875.754050:0:13086:0:(genops.c:885:class_export_put()) final put ffff8da5bf491800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787582875.754072:0:13086:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8da5a1567000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787582875.754075:0:13086:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8da5a1567000 2 00000020:01000004:0.0:1787582875.754078:0:13086:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8da5a1567000 from lustre-OST0000 00000020:00000080:0.0:1787582875.754100:0:13086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787582875.754109:0:13086:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787582875.754112:0:13086:0:(genops.c:885:class_export_put()) final put ffff8da58df1a000/lustre-OST0000_UUID 00000020:00000080:0.0:1787582875.754114:0:13086:0:(genops.c:844:class_export_destroy()) destroying export ffff8da58df1a000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787582875.754120:0:13086:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787582875.754190:0:13086:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787582875.754195:0:13086:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787582875.754206:0:13086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787582875.754211:0:13086:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787582875.754217:0:13086:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8da5bf497000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787582875.754222:0:13086:0:(genops.c:1553:class_disconnect_exports()) OBD device 13 (ffff8da589c28000) has exports, disconnecting them 00000020:00080000:0.0:1787582875.754227:0:13086:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8da5bf497000), last request at 1787582655 00000020:00000080:0.0:1787582875.754230:0:13086:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537aca 00000020:00080000:0.0:1787582875.754240:0:13086:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8da5bf497000): rc 0 00000020:00000080:0.0:1787582875.754244:0:13086:0:(genops.c:885:class_export_put()) final put ffff8da5bf497000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787582875.754572:0:12709:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bf491800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787582875.754585:0:12709:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bf497000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787582875.755104:0:13086:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787582875.755109:0:13086:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787582875.755113:0:13086:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787582875.755118:0:13086:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787582875.755248:0:13086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787582875.755254:0:13086:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787582875.755258:0:13086:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8da5a1567000 1 00000020:00000080:0.0:1787582875.755262:0:13086:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537a0d 00000020:00000080:0.0:1787582875.755268:0:13086:0:(genops.c:885:class_export_put()) final put ffff8da5a082b800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787582875.755272:0:13086:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787582875.755278:0:13086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787582875.755281:0:13086:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787582875.755284:0:13086:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8da5b50219b8) has no exports 00000020:00000080:1.0:1787582875.755410:0:12709:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da5bbba3800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787582875.755417:0:12709:0:(genops.c:885:class_export_put()) final put ffff8da5bf45f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787582875.755420:0:12709:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bf45f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787582875.755425:0:12709:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787582875.755464:0:12709:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5a082b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787582875.786013:0:13086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787582875.786029:0:13086:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787582875.786034:0:13086:0:(genops.c:885:class_export_put()) final put ffff8da5bbb7b800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787582875.786038:0:13086:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bbb7b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787582875.786046:0:13086:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787582875.786160:0:13086:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8da5bbb7a000 00000020:02000400:2.0:1787582875.786203:0:13086:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787582876.307412:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787582876.753387:0:12709:0:(pinger.c:229:ptlrpc_pinger_process_import()) 615b3d9a-8a7c-4227-a987-f23a2209c536->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787582876.753395:0:12709:0:(pinger.c:247:ptlrpc_pinger_process_import()) 615b3d9a-8a7c-4227-a987-f23a2209c536->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787582876.753398:0:12709:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787582876.753402:0:12709:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787582876.753405:0:12709:0:(import.c:65:import_set_state_nolock()) ffff8da58df1e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787582876.753412:0:12709:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 412 00000100:00080000:3.0:1787582876.753416:0:12709:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787582876.753421:0:12709:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8da58df1e000 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:3.0:1787582876.753451:0:12709:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5ad9adf80 x1874416186251264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787582876.754046:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874416186251264:0@lo:38:kworker.0 00000400:00000100:1.0:1787582876.754098:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874416186251264 offset 0 length 520: 4 00010000:00010000:0.0:1787582877.328451:0:5841:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582878.358680:0:12930:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787582879.119807:0:13236:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787582879.135478:0:13236:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787582879.135631:0:13236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c3d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582879.135645:0:13236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537c3d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582879.135667:0:13236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537c3d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582879.135673:0:13236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537c3d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582879.136294:0:13236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787582879.136303:0:13236:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787582879.136363:0:13236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787582879.136375:0:13236:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8da5ad9adf80 x1874416186251264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787582891 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582879.136394:0:13236:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787582879.136402:0:13236:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787582879.136407:0:13236:0:(import.c:65:import_set_state_nolock()) ffff8da58df1e000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787582879.136411:0:13236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787582879.136415:0:13236:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8da5ad9adf80 x1874416186251264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787582891 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582879.136421:0:13236:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787582879.136424:0:13236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:3.0:1787582879.136661:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874416186251264:0@lo:38:kworker.0 00010000:00010000:0.0:1787582879.139630:0:13236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537c4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582879.139647:0:13236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537c4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582879.139655:0:13236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537c4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582879.139681:0:13236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537c4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582879.142623:0:12929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787582879.142636:0:12929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537c3d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582879.142648:0:12929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581686a00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1787582879.142652:0:12929:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537c3d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582879.142662:0:12929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa113d808b7537c3d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582879.142669:0:12929:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa113d808b7537c3d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582879.142674:0:12929:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787582879.142693:0:12929:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787582879.142696:0:12929:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787582879.142715:0:12929:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8da59102f000 00010000:00010000:1.0:1787582879.142719:0:12929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa113d808b7537c3d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582879.142736:0:12929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da581686a00/0xa113d808b7537c36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa113d808b7537c3d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582879.142750:0:12929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582879.142753:0:12929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537c4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582879.142758:0:12929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da581686600 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:1.0:1787582879.142761:0:12929:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537c4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582879.142767:0:12929:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa113d808b7537c4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787582879.142773:0:12929:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa113d808b7537c4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582879.142778:0:12929:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787582879.142780:0:12929:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1787582879.142784:0:12929:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8da59102f000 00010000:00010000:1.0:1787582879.142786:0:12929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa113d808b7537c4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582879.142792:0:12929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582879.142793:0:12929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582879.142800:0:12929:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582879.142946:0:13236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787582879.142953:0:13236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da581686600/0xa113d808b7537c44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa113d808b7537c4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582879.142966:0:13236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7537e74 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582879.142973:0:13236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7537e74 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582879.142990:0:13236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537e74 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582879.142997:0:13236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa113d808b7537e74 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582879.143298:0:11179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582879.143305:0:11179:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537e74 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582879.143312:0:11179:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4e9da00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1787582879.143578:0:11179:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa113d808b7537e74 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582879.143590:0:11179:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa113d808b7537e74 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582879.143596:0:11179:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa113d808b7537e74 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582879.143601:0:11179:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787582879.143603:0:11179:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787582879.143610:0:11179:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8da59102f000 00010000:00010000:2.0:1787582879.143613:0:11179:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa113d808b7537e74 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582879.143708:0:13236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787582879.143712:0:13236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9da00/0xa113d808b7537e6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa113d808b7537e74 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582879.143802:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787582879.143823:0:13236:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787582879.143828:0:13236:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1787582879.143830:0:13236:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787582879.143864:0:13236:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787582879.143867:0:13236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787582879.143875:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787582879.143889:0:13236:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787582879.143892:0:13236:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8da5b5020000) has no exports 00000020:00080000:0.0:1787582879.143924:0:13236:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8da5b5020000) has no exports 00010000:00010000:3.0:1787582879.145426:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582879.145432:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582879.145435:0:11179:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787582879.147107:0:13236:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8da585274720 - data ffff8da5bfd0c510/ffff8da5bb4fd400 00000020:01000000:0.0:1787582879.147306:0:13236:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8da5a16c52a0 - data ffff8da4814f0360/ffff8da5bf228800 00100000:10000000:2.0:1787582879.169864:0:13236:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787582879.199432:0:13236:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537b2c 00000020:00000080:0.0:1787582879.199443:0:13236:0:(genops.c:885:class_export_put()) final put ffff8da5bf45d800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787582879.199457:0:13236:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8da5bb7f0800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787582879.199461:0:13236:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8da5bb7f0800 2 00000020:01000004:0.0:1787582879.199464:0:13236:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8da5bb7f0800 from lustre-OST0001 00000020:00000080:0.0:1787582879.199492:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787582879.199510:0:13236:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787582879.199513:0:13236:0:(genops.c:885:class_export_put()) final put ffff8da591028800/lustre-OST0001_UUID 00000020:00000080:0.0:1787582879.199516:0:13236:0:(genops.c:844:class_export_destroy()) destroying export ffff8da591028800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787582879.199522:0:13236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787582879.199631:0:13236:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 615b3d9a-8a7c-4227-a987-f23a2209c536->MGS 00010000:00010000:0.0:1787582879.199644:0:13236:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da580030000/0xa113d808b7537a5a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa113d808b7537a61 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582879.199655:0:13236:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da580030000/0xa113d808b7537a5a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa113d808b7537a61 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582879.199662:0:13236:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787582879.199664:0:13236:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787582879.199667:0:13236:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787582879.199683:0:13236:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8da59102f000 00010000:00010000:0.0:1787582879.199687:0:13236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da580030000/0xa113d808b7537a5a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa113d808b7537a61 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582879.199700:0:13236:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d200/0xa113d808b7537c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa113d808b7537c91 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787582879.199719:0:13236:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d200/0xa113d808b7537c8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa113d808b7537c91 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787582879.199735:0:13236:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787582879.199738:0:13236:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787582879.199739:0:13236:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787582879.199748:0:13236:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8da59102f000 00010000:00010000:0.0:1787582879.199750:0:13236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5b4e9d200/0xa113d808b7537c8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa113d808b7537c91 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787582879.199765:0:13236:0:(import.c:65:import_set_state_nolock()) ffff8da59102f000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787582879.199768:0:13236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787582879.199770:0:13236:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787582879.199771:0:13236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787582879.199774:0:13236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787582879.199783:0:13236:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8da5ad9afb80 x1874416186251136/t0(0) o250->MGC192.168.206.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787582885 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787582879.199798:0:13236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787582879.199801:0:13236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:3.0:1787582879.199996:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bf45d800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1787582879.200184:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:615b3d9a-8a7c-4227-a987-f23a2209c536:3310:1874416186251136:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:0.0:1787582879.200279:0:13236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787582879.200286:0:13236:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b753791f 00000020:00000080:0.0:1787582879.200291:0:13236:0:(genops.c:885:class_export_put()) final put ffff8da59102d800/615b3d9a-8a7c-4227-a987-f23a2209c536 00000020:01000000:0.0:1787582879.200304:0:13236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.120@tcp (flags='') 00000020:00000080:0.0:1787582879.200309:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787582879.200313:0:13236:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.120@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787582879.200333:0:13236:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8da588590000) has no exports 10000000:01000000:1.0:1787582879.200378:0:5851:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:3.0:1787582879.200454:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da59102d800/615b3d9a-8a7c-4227-a987-f23a2209c536 for MGC192.168.206.120@tcp 10000000:01000000:0.0:1787582879.200480:0:13236:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.120@tcp: client import never connected 00000100:00080000:0.0:1787582879.200483:0:13236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787582879.200485:0:13236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787582879.200487:0:13236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787582879.200501:0:13236:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787582879.200542:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787582879.200546:0:13236:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.120@tcp (uuid 615b3d9a-8a7c-4227-a987-f23a2209c536) 00000020:01000000:0.0:1787582879.200551:0:13236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787582879.200553:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787582879.200557:0:13236:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787582879.200561:0:13236:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8da5a8c09000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787582879.200566:0:13236:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8da5b5024d28) has exports, disconnecting them 00000020:00080000:0.0:1787582879.200569:0:13236:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8da5a8c09000), last request at 1787582674 00000020:00000080:0.0:1787582879.200573:0:13236:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537b56 00000020:00080000:0.0:1787582879.200581:0:13236:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8da5a8c09000): rc 0 00000020:00000080:0.0:1787582879.200584:0:13236:0:(genops.c:885:class_export_put()) final put ffff8da5a8c09000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787582879.200847:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da59102f000 for MGC192.168.206.120@tcp 00000020:00000080:3.0:1787582879.200853:0:38:0:(genops.c:885:class_export_put()) final put ffff8da59102a000/615b3d9a-8a7c-4227-a987-f23a2209c536 00000020:00000080:3.0:1787582879.200855:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da59102a000/615b3d9a-8a7c-4227-a987-f23a2209c536 for MGC192.168.206.120@tcp 00000020:01000000:3.0:1787582879.200859:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.120@tcp (615b3d9a-8a7c-4227-a987-f23a2209c536) 00000020:00000080:3.0:1787582879.201141:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5a8c09000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787582879.226465:0:13236:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787582879.226474:0:13236:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787582879.226478:0:13236:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787582879.226486:0:13236:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787582879.226567:0:5841:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787582879.226599:0:12930:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787582879.226811:0:12929:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1787582879.226882:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00010000:00010000:3.0:1787582879.227041:0:11179:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-5 blwis in pool) 00000100:00100000:3.0:1787582879.227127:0:5837:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8da586c67600:5837] 1 exiting: rc = 0 00000020:00000080:3.0:1787582879.227177:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8da58df1e000 for lustre-MDT0000-lwp-OST0001 00000100:00100000:1.0:1787582879.227243:0:5836:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8da586c67200:5836] 0 exiting: rc = 1 00000100:00100000:0.0:1787582879.227282:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.227535:0:5840:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8da588474400:5840] 2 exiting: rc = 0 00000100:00100000:1.0:1787582879.227547:0:5838:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8da585e85000:5838] 0 exiting: rc = 1 00000100:00100000:1.0:1787582879.227617:0:8463:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8da58840ba00:8463] 3 exiting: rc = 0 00000100:00100000:3.0:1787582879.228083:0:5839:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8da588474a00:5839] 1 exiting: rc = 0 00000100:00100000:0.0:1787582879.228179:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228186:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228192:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228199:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228216:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228222:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228227:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228233:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228238:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228244:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228249:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228255:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228271:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228277:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228283:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228288:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228294:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228303:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228309:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228392:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228399:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228405:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228409:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228413:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228418:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228422:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228426:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228430:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228434:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228438:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228442:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228446:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228451:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228456:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228460:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228464:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228468:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228472:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228477:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228481:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228485:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228490:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228616:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228625:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228630:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228637:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228641:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228653:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228658:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228663:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228669:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228674:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228679:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228685:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228690:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228695:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228700:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228705:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228710:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228715:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228720:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228840:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228848:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.228853:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787582879.230975:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787582879.230995:0:13236:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787582879.231001:0:13236:0:(genops.c:885:class_export_put()) final put ffff8da5bf45b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787582879.231005:0:13236:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bf45b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787582879.231010:0:13236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787582879.231062:0:13236:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8da5bb7f0800 1 00000020:00000080:0.0:1787582879.231068:0:13236:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa113d808b7537afb 00000020:00000080:0.0:1787582879.231073:0:13236:0:(genops.c:885:class_export_put()) final put ffff8da5ad763000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787582879.231093:0:13236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787582879.231098:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787582879.231102:0:13236:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787582879.231105:0:13236:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8da589c2cd28) has no exports 00000020:00000080:3.0:1787582879.231190:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5ad763000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787582879.322395:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787582879.322410:0:13236:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787582879.322415:0:13236:0:(genops.c:885:class_export_put()) final put ffff8da5bb7f6000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787582879.322420:0:13236:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5bb7f6000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787582879.322442:0:13236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787582879.322790:0:13236:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8da5bb7f3800 00000020:01000000:0.0:1787582879.322812:0:13236:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787582879.322816:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787582879.322821:0:13236:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787582879.322825:0:13236:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8da589c299b8) has no exports 00000020:00000080:0.0:1787582879.322855:0:13236:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787582879.322861:0:13236:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787582879.322864:0:13236:0:(genops.c:885:class_export_put()) final put ffff8da5a0828800/OSS_uuid 00000020:00000080:0.0:1787582879.322866:0:13236:0:(genops.c:844:class_export_destroy()) destroying export ffff8da5a0828800/OSS_uuid for OSS 00000020:01000000:0.0:1787582879.322870:0:13236:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1787582879.322893:0:5849:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787582879.323063:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8da588475200:6705] 2 exiting: rc = 0 00000100:00100000:0.0:1787582879.323112:0:12082:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8da589e68c00:12082] 4 exiting: rc = 0 00000100:00100000:3.0:1787582879.325230:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8da589c30e00:6704] 1 exiting: rc = 0 00000100:00100000:2.0:1787582879.325354:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8da589c30c00:6703] 0 exiting: rc = 1 00000100:00100000:1.0:1787582879.325569:0:8218:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8da5bf709e00:8218] 3 exiting: rc = 0 00000100:00100000:2.0:1787582879.327019:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327033:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327039:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327047:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327052:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327057:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327061:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327066:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327071:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327076:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327082:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327087:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327093:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327098:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327103:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327108:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327115:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327122:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327130:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327137:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327142:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327147:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327152:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327161:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327166:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327173:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327179:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327185:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327189:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327194:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327199:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327583:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327591:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327596:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327610:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327615:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327620:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327625:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327630:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327635:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327640:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327648:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327653:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327658:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327664:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327668:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327678:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327683:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327689:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327694:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327699:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327704:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327708:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327713:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.327718:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.328422:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.328440:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.328445:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.328449:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.328454:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.328458:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.328463:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.328468:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.328472:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.330526:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8da5ad62ce00:6706] 0 exiting: rc = 1 00000100:00100000:3.0:1787582879.330530:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8da589c31200:6707] 1 exiting: rc = 0 00000100:00100000:2.0:1787582879.330604:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330612:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330617:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330621:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330626:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330644:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330649:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330653:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330658:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330663:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330667:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330673:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330678:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330683:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330688:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330693:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330698:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330703:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330709:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330714:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.330719:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331053:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331062:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331067:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331072:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331077:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331081:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331086:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331091:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331097:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331102:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331107:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331111:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331116:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331120:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331126:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331131:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331137:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331142:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331147:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331180:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331186:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331192:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331197:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331202:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331217:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331223:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331228:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331233:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331238:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331244:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331249:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331255:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331260:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331264:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331269:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331276:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331281:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331287:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331292:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331297:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331302:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331308:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.331354:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.332842:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8da5ad709c00:6709] 1 exiting: rc = 0 00000100:00100000:3.0:1787582879.333065:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8da5ad709a00:6708] 0 exiting: rc = 1 00000100:00100000:1.0:1787582879.335466:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8da5b4fbe200:6710] 2 exiting: rc = 0 00000100:00100000:0.0:1787582879.335895:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.335905:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.335912:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.335918:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.335923:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.335930:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.335946:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.335953:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.335960:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.335966:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.335972:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.335978:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.335997:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336002:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336009:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336016:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336021:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336027:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336045:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336678:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336690:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336695:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336885:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336909:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336915:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336921:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336926:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336932:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336938:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336944:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336949:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336955:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336960:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.336965:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337059:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337064:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337069:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337074:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337079:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337398:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337405:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337411:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337417:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337422:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337427:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337432:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337438:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337463:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337470:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337475:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337481:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337486:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337492:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337509:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337514:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337520:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337524:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337530:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337536:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337542:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337547:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337552:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.337566:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787582879.340021:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787582879.349236:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8da5b4fbec00:6711] 0 exiting: rc = 1 00000100:00100000:2.0:1787582879.354727:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8da5b4fbf800:6712] 1 exiting: rc = 0 00000100:00100000:2.0:1787582879.354843:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354850:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354855:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354860:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354865:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354870:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354875:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354881:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354886:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354891:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354912:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354917:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354922:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354928:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354933:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354938:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354944:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354949:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354954:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354959:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354964:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354969:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.354975:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355159:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355169:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355174:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355180:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355185:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355190:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355195:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355201:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355206:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355211:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355217:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355222:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355228:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355233:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355239:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355244:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355249:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355255:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355260:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355266:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355272:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355277:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355289:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355294:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355300:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355305:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355310:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355315:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355341:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355346:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355351:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355357:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355362:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355367:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355372:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355378:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355382:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355389:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355394:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355399:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.355404:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787582879.357889:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8da586eefc00:6713] 0 exiting: rc = 1 00000100:00100000:1.0:1787582879.359661:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8da586eefa00:6714] 1 exiting: rc = 0 00000100:00100000:2.0:1787582879.360166:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360183:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360200:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360207:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360213:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360219:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360225:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360231:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360237:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360244:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360250:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360256:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360343:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360352:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360374:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360382:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360402:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360409:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360416:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360435:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360442:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360448:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360454:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360460:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360466:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360472:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360494:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360501:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360507:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360513:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360520:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360526:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360531:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360537:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360542:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360548:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360553:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.360558:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362116:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362130:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362136:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362143:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362149:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362156:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362162:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362168:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362175:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362180:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362186:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362191:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362216:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362233:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362239:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362246:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362254:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362478:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362487:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362493:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362501:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362507:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362512:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362521:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362526:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787582879.362541:0:13236:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787582879.372680:0:13236:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787582896.129563:0:13851:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg620-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787582905.974129:0:14311:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787582905.974134:0:14311:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787582905.974247:0:14311:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8da5ad665000 00000020:01000004:3.0:1787582905.974261:0:14311:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787582905.974268:0:14311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787582905.974281:0:14311:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8da5bf2dcd28) 00000020:00000080:3.0:1787582905.974292:0:14311:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787582905.995526:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787582905.999540:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1787582906.000188:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 365: rc = 0 00100000:10000000:0.0:1787582906.002702:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 365: rc = 0 00100000:10000000:0.0:1787582906.002833:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 365: rc = 0 00100000:10000000:0.0:1787582906.002961:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 365: rc = 0 00100000:10000000:0.0:1787582906.003062:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 365: rc = 0 00100000:10000000:0.0:1787582906.003263:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787582906.003353:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 365: rc = 0 00100000:10000000:0.0:1787582906.004969:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 367: rc = 0 00100000:10000000:0.0:1787582906.007482:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 169: rc = 0 00100000:10000000:0.0:1787582906.007717:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 169: rc = 0 00100000:10000000:0.0:1787582906.008723:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 672: rc = 0 00100000:10000000:0.0:1787582906.009181:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 672: rc = 0 00100000:10000000:0.0:1787582906.009800:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 672: rc = 0 00100000:10000000:0.0:1787582906.010169:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 672: rc = 0 00100000:10000000:0.0:1787582906.011018:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 672: rc = 0 00100000:10000000:0.0:1787582906.011524:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 672: rc = 0 00100000:10000000:0.0:1787582906.012060:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 672: rc = 0 00100000:10000000:0.0:1787582906.012627:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 672: rc = 0 00100000:10000000:0.0:1787582906.012906:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 672: rc = 0 00100000:10000000:0.0:1787582906.013251:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 672: rc = 0 00100000:10000000:0.0:1787582906.013540:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 672: rc = 0 00100000:10000000:0.0:1787582906.013790:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 672: rc = 0 00100000:10000000:0.0:1787582906.014791:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 770: rc = 0 00100000:10000000:0.0:1787582906.015790:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 770: rc = 0 00100000:10000000:0.0:1787582906.016550:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 770: rc = 0 00100000:10000000:0.0:1787582906.017152:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 770: rc = 0 00100000:10000000:0.0:1787582906.017556:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 770: rc = 0 00100000:10000000:0.0:1787582906.018097:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 770: rc = 0 00100000:10000000:0.0:1787582906.018574:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 770: rc = 0 00100000:10000000:0.0:1787582906.019113:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 770: rc = 0 00100000:10000000:0.0:1787582906.019686:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 770: rc = 0 00100000:10000000:0.0:1787582906.020150:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 770: rc = 0 00100000:10000000:0.0:1787582906.020731:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 770: rc = 0 00100000:10000000:0.0:1787582906.021194:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 770: rc = 0 00100000:10000000:0.0:1787582906.021693:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 770: rc = 0 00100000:10000000:0.0:1787582906.023795:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 770: rc = 0 00100000:10000000:0.0:1787582906.024479:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 770: rc = 0 00100000:10000000:0.0:1787582906.024799:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 770: rc = 0 00100000:10000000:0.0:1787582906.025425:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 770: rc = 0 00100000:10000000:0.0:1787582906.025761:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 770: rc = 0 00100000:10000000:0.0:1787582906.026437:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 770: rc = 0 00100000:10000000:0.0:1787582906.026768:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 770: rc = 0 00100000:10000000:0.0:1787582906.027426:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 770: rc = 0 00100000:10000000:0.0:1787582906.027700:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 770: rc = 0 00100000:10000000:0.0:1787582906.028004:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 770: rc = 0 00100000:10000000:0.0:1787582906.028280:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 770: rc = 0 00100000:10000000:0.0:1787582906.028568:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 770: rc = 0 00100000:10000000:0.0:1787582906.028808:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 770: rc = 0 00100000:10000000:0.0:1787582906.029075:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 770: rc = 0 00100000:10000000:0.0:1787582906.029310:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 770: rc = 0 00100000:10000000:0.0:1787582906.031027:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 770: rc = 0 00100000:10000000:0.0:1787582906.031737:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 770: rc = 0 00100000:10000000:0.0:1787582906.032376:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 770: rc = 0 00100000:10000000:0.0:1787582906.032797:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 770: rc = 0 00100000:10000000:0.0:1787582906.033467:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 675: rc = 0 00100000:10000000:0.0:1787582906.036107:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1787582906.036495:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 172: rc = 0 00100000:10000000:0.0:1787582906.037200:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1787582906.037292:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 172: rc = 0 00100000:10000000:0.0:1787582906.037527:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1787582906.037618:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 172: rc = 0 00100000:10000000:0.0:1787582906.038021:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1787582906.038094:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 170: rc = 0 00100000:10000000:0.0:1787582906.038296:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1787582906.038756:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 170: rc = 0 00100000:10000000:0.0:1787582906.039496:0:14311:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1787582906.039584:0:14311:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 170: rc = 0 00000020:00000080:0.0:1787582906.040293:0:14311:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787582906.040307:0:14311:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787582906.040453:0:14311:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa113d808b7538c20 00000020:01000004:0.0:1787582906.040462:0:14311:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787582906.040467:0:14311:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787582906.040472:0:14311:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8da5ad665000 from MGS 00000020:01000004:0.0:1787582906.040476:0:14311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787582906.040486:0:14311:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8da5b60699b8) 00000020:00000080:0.0:1787582906.040497:0:14311:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787582906.040556:0:14311:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8da5ad665000 from MGS, refs=2 00080000:01000000:0.0:1787582906.040561:0:14311:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787582906.040715:0:14311:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa113d808b7538c2e 00000100:00100000:0.0:1787582906.041061:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787582906.041194:0:14311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787582906.041201:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787582906.042164:0:14311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787582906.042173:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787582906.043379:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787582906.043546:0:14311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787582906.043551:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787582906.045026:0:14311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787582906.045036:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787582906.045492:0:14311:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787582906.045499:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787582906.048759:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582906.048765:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582906.048767:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582906.049460:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582906.049463:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582906.049465:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582906.050460:0:14311:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787582906.056425:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787582906.069309:0:14311:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787582906.069408:0:14311:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787582906.069412:0:14311:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787582906.072452:0:14320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787582906.072715:0:14311:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787582906.072828:0:14311:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787582906.076218:0:14311:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787582906.077191:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787582906.078343:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787582906.078352:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787582906.089364:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787582906.089379:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787582906.090161:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787582906.090170:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1787582906.091359:0:14325:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1787582906.091564:0:14311:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787582906.091720:0:14311:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.120@tcp' 00000020:01000004:2.0:1787582906.091722:0:14311:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787582906.091750:0:14311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.120@tcp (typ=mgc) 00000020:00000080:2.0:1787582906.091764:0:14311:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.120@tcp (ffff8da5b50219b8) 00000020:00000080:2.0:1787582906.091779:0:14311:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787582906.092373:0:14311:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8da585f7d800@MGC192.168.206.120@tcp: add connection 192.168.206.120@tcp at head 00010000:00010000:2.0:1787582906.092522:0:14311:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.120@tcp-0 is initialized 00000040:01000000:2.0:1787582906.092527:0:14311:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.120@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787582906.098821:0:14326:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787582906.099034:0:14311:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.120@tcp (uuid 3e2cf41e-7ffc-455b-9803-c6c5675ba817) 00000020:00000080:2.0:1787582906.099058:0:14311:0:(genops.c:1385:class_connect()) connect: client 3e2cf41e-7ffc-455b-9803-c6c5675ba817, cookie 0xa113d808b7538c3c 00000100:00080000:2.0:1787582906.099069:0:14311:0:(import.c:510:import_select_connection()) MGC192.168.206.120@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787582906.099089:0:14311:0:(import.c:624:import_select_connection()) MGC192.168.206.120@tcp: import ffff8da585f7d800 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:2.0:1787582906.099121:0:14311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5adbf6d80 x1874416186251392/t0(0) o250->MGC192.168.206.120@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787582906.099148:0:14311:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 3e2cf41e-7ffc-455b-9803-c6c5675ba817->MGS 00000020:01000004:2.0:1787582906.099170:0:14311:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787582906.099176:0:14311:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787582906.099189:0:14311:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8da5b5024d28) 00000020:00000080:2.0:1787582906.099200:0:14311:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787582906.101064:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3310:1874416186251392:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787582906.101144:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582906.101253:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186251392 00000100:00100000:1.0:1787582906.101262:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186251392 00000100:00100000:1.0:1787582906.101295:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582906.101303:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf6e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1874416186251392:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787582906.101350:0:14321:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3e2cf41e-7ffc-455b-9803-c6c5675ba817@0@lo t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:1.0:1787582906.101376:0:14321:0:(genops.c:1385:class_connect()) connect: client 3e2cf41e-7ffc-455b-9803-c6c5675ba817, cookie 0xa113d808b7538c4a 00000100:00080000:1.0:1787582906.101503:0:14321:0:(import.c:65:import_set_state_nolock()) ffff8da5b4c97800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582906.101551:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf6e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+5:3310:x1874416186251392:12345-0@lo:250:mount.lustre.0 Request processed in 248us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582906.101559:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582906.102027:0:3310:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.120@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787582906.102036:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.120@tcp: connect to target with instance 0 00000100:00080000:1.0:1787582906.102043:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.120@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787582906.102047:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787582906.102051:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da585f7d800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787582906.102053:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787582906.102060:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787582906.102067:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3310:1874416186251392:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787582906.124156:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787582906.124373:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787582906.124381:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787582906.129036:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787582906.129053:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787582906.133152:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787582906.133162:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787582906.134357:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787582906.134509:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787582906.134514:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787582906.137161:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787582906.137180:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787582906.200519:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787582906.201119:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787582906.201126:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787582906.202817:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787582906.202829:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787582906.203880:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787582906.204213:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787582906.204218:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787582906.205307:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787582906.205424:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787582906.206447:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787582906.207177:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787582906.207184:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787582906.212097:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787582906.212116:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787582906.213470:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787582906.213755:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787582906.213760:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787582906.214708:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787582906.214715:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787582906.250871:0:14311:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787582906.251177:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787582906.251184:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787582906.260099:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787582906.260211:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787582906.261465:0:14311:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787582906.261475:0:14311:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787582906.263188:0:14311:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787582906.263212:0:14311:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787582906.263218:0:14311:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.120@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787582906.263510:0:14311:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787582906.263541:0:14311:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.120@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787582906.263545:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787582906.263547:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787582906.263548:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582906.263549:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582906.263551:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582906.263552:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582906.263553:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787582906.263555:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787582906.263556:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582906.263558:0:14311:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787582906.263560:0:14311:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787582906.263562:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787582906.263564:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787582906.263565:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582906.263566:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582906.263572:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582906.263573:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582906.263574:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787582906.263575:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787582906.263638:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582906.263639:0:14311:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787582906.263664:0:14311:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787582906.263682:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186251520:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787582906.263760:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582906.263875:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a0640d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787582906.264154:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186251520 00000100:00100000:0.0:1787582906.264161:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186251520 00000100:00100000:0.0:1787582906.264239:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787582906.264249:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf6e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+5:14311:x1874416186251520:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787582906.264293:0:14324:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787582906.264296:0:14324:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787582906.264299:0:14324:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787582906.264705:0:14345:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787582906.265495:0:14324:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1787582906.269749:0:14346:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787582906.269758:0:14346:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787582906.269761:0:14346:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787582906.269815:0:14346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787582906.270347:0:14324:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787582906.270358:0:14324:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787582906.296176:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf6e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+5:14311:x1874416186251520:12345-0@lo:253:mount.lustre.0 Request processed in 31920us (32407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582906.296190:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787582906.296292:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186251520:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787582906.296308:0:14311:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787582906.296311:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787582906.296313:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787582906.296314:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582906.296341:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582906.296342:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582906.296344:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582906.296346:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787582906.296347:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787582906.296349:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582906.296350:0:14311:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787582906.296368:0:14311:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8da5ad665000 from lustre-MDT0000 10000000:01000000:2.0:1787582906.296394:0:14311:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787582906.296396:0:14311:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787582906.296400:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8da5b50219b8 10000000:01000000:2.0:1787582906.296404:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787582906.296410:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8da5b50219b8 from 1 10000000:01000000:2.0:1787582906.296413:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787582906.296447:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ea00/0xa113d808b7538c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.296458:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ea00/0xa113d808b7538c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.296485:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ea00/0xa113d808b7538c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582906.296503:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186251648:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787582906.296541:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582906.296571:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a0640240 going to sleep for 11 seconds 00000100:00100000:1.0:1787582906.296607:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186251648 00000100:00100000:1.0:1787582906.296614:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186251648 00000100:00100000:1.0:1787582906.296655:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787582906.296664:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+5:14311:x1874416186251648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787582906.296676:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582906.296689:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5bb6b7000/0xa113d808b7538c58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538c51 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582906.296710:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5bb6b7000/0xa113d808b7538c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538c51 expref: 6 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582906.296720:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5bb6b7000/0xa113d808b7538c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538c51 expref: 6 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582906.296730:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b7000, rc 0) 00000100:00100000:1.0:1787582906.296769:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+6:14311:x1874416186251648:12345-0@lo:101:mount.lustre.0 Request processed in 107us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582906.296775:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787582906.297139:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186251648:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787582906.297152:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ea00/0xa113d808b7538c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538c58 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.297161:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ea00/0xa113d808b7538c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538c58 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582906.297213:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186251776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787582906.297240:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582906.297270:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a0640240 going to sleep for 11 seconds 00000100:00100000:0.0:1787582906.297345:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186251776 00000100:00100000:0.0:1787582906.297350:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186251776 00000100:00100000:0.0:1787582906.297379:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787582906.297386:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+6:14311:x1874416186251776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787582906.297599:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+6:14311:x1874416186251776:12345-0@lo:501:mount.lustre.0 Request processed in 213us (357us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787582906.297606:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787582906.297707:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186251776:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787582906.297738:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787582906.297758:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ea00/0xa113d808b7538c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538c58 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.297767:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ea00/0xa113d808b7538c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538c58 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582906.297775:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8da5ad665000 10000000:01000000:2.0:1787582906.297780:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787582906.297790:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8da5ad665000 10000000:01000000:2.0:1787582906.297792:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787582906.297795:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8da5ad665000 from 1 10000000:01000000:2.0:1787582906.297798:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787582906.297817:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9e600/0xa113d808b7538c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.297824:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9e600/0xa113d808b7538c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.297841:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9e600/0xa113d808b7538c5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582906.297855:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186251904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787582906.297882:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582906.297893:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a0640240 going to sleep for 11 seconds 00000100:00100000:0.0:1787582906.297957:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186251904 00000100:00100000:0.0:1787582906.297961:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186251904 00000100:00100000:0.0:1787582906.298001:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787582906.298007:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+6:14311:x1874416186251904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787582906.298016:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582906.298028:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5c20efe00/0xa113d808b7538c66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538c5f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.298057:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5c20efe00/0xa113d808b7538c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538c5f expref: 7 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.298065:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5c20efe00/0xa113d808b7538c66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538c5f expref: 7 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.298074:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20efe00, rc 0) 00000100:00100000:0.0:1787582906.298101:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+7:14311:x1874416186251904:12345-0@lo:101:mount.lustre.0 Request processed in 94us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582906.298107:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787582906.298249:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186251904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787582906.298260:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9e600/0xa113d808b7538c5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538c66 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.298267:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9e600/0xa113d808b7538c5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538c66 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582906.298279:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787582906.298292:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9e600/0xa113d808b7538c5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538c66 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.298298:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9e600/0xa113d808b7538c5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538c66 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582906.298314:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787582906.298335:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787582906.298339:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8da5ad665000 10000000:01000000:2.0:1787582906.298342:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787582906.298345:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787582906.298347:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787582906.298362:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ee00/0xa113d808b7538c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.298369:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ee00/0xa113d808b7538c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.298376:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ee00/0xa113d808b7538c6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582906.298390:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186252032:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787582906.298415:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582906.298432:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a0640240 going to sleep for 11 seconds 00000100:00100000:1.0:1787582906.298482:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186252032 00000100:00100000:1.0:1787582906.298487:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186252032 00000100:00100000:1.0:1787582906.298509:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787582906.298516:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+7:14311:x1874416186252032:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787582906.298522:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582906.298530:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5bb6b6800/0xa113d808b7538c74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538c6d expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582906.298553:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5bb6b6800/0xa113d808b7538c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538c6d expref: 8 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582906.298561:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5bb6b6800/0xa113d808b7538c74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538c6d expref: 8 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582906.298582:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6800, rc 0) 00000100:00100000:1.0:1787582906.298607:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+8:14311:x1874416186252032:12345-0@lo:101:mount.lustre.0 Request processed in 92us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582906.298613:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787582906.299097:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186252032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787582906.299111:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ee00/0xa113d808b7538c6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538c74 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.299119:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ee00/0xa113d808b7538c6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538c74 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582906.299166:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186252160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787582906.299195:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582906.299231:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a0640240 going to sleep for 11 seconds 00000100:00100000:1.0:1787582906.299559:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186252160 00000100:00100000:1.0:1787582906.299580:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186252160 00000100:00100000:1.0:1787582906.299610:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787582906.299617:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+8:14311:x1874416186252160:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787582906.300019:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+9:14311:x1874416186252160:12345-0@lo:501:mount.lustre.0 Request processed in 402us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582906.300026:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787582906.300189:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186252160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787582906.300222:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186252288:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787582906.300263:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582906.300292:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a0640240 going to sleep for 11 seconds 00000100:00100000:0.0:1787582906.300660:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186252288 00000100:00100000:0.0:1787582906.300667:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186252288 00000100:00100000:0.0:1787582906.300707:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787582906.300715:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+9:14311:x1874416186252288:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787582906.301226:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+9:14311:x1874416186252288:12345-0@lo:503:mount.lustre.0 Request processed in 510us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582906.301233:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787582906.301437:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186252288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787582906.303361:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad933480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14347:1874416186252416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582906.303437:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582906.303478:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5834da540 going to sleep for 11 seconds 00000100:00100000:2.0:1787582906.303485:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186252416 00000100:00100000:2.0:1787582906.303492:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186252416 00000100:00100000:2.0:1787582906.303535:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787582906.303544:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+9:14347:x1874416186252416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582906.304073:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+9:14347:x1874416186252416:12345-0@lo:502:llog_process_th.0 Request processed in 528us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582906.304081:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787582906.304472:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad933480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14347:1874416186252416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787582906.304499:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787582906.304509:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582906.304511:0:14347:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787582906.304516:0:14347:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787582906.304519:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787582906.304539:0:14347:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8da5b6068000) 00000020:00000080:0.0:1787582906.304554:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787582906.304560:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787582906.304618:0:14347:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787582906.304626:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa113d808b7538c82 00000020:00000080:0.0:1787582906.304826:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787582906.304831:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787582906.304847:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582906.304849:0:14347:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787582906.304852:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787582906.304855:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582906.304857:0:14347:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787582906.304860:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787582906.304868:0:14347:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8da5b606cd28) 00000020:00000080:0.0:1787582906.304877:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787582906.304880:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787582906.304882:0:14347:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787582906.304885:0:14347:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787582906.304891:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787582906.304940:0:14347:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8da5ad665000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787582906.304952:0:14347:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8da5b606b370) 00000020:00000080:0.0:1787582906.304961:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787582906.304999:0:14347:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787582906.305008:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa113d808b7538c97 00000020:00000080:0.0:1787582906.305104:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787582906.305111:0:14347:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787582906.305115:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa113d808b7538c9e 00080000:01000000:0.0:1787582906.305120:0:14347:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787582906.305124:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa113d808b7538ca5 00010000:00010000:2.0:1787582906.402530:0:14347:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787582906.403199:0:14347:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787582906.403405:0:14347:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787582906.404250:0:14347:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8da5b5020000) 00000020:00000080:2.0:1787582906.404267:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787582906.404363:0:14347:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787582906.404370:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa113d808b7538cb3 00000020:00000080:3.0:1787582906.405078:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787582906.410482:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa113d808b7538cba 00000020:00000080:1.0:1787582906.411866:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787582906.411880:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582906.411886:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582906.411888:0:14347:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787582906.411891:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787582906.411894:0:14347:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1787582906.411896:0:14347:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787582906.411897:0:14347:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787582906.411898:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787582906.411901:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582906.411902:0:14347:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787582906.411915:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582906.411926:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582906.411927:0:14347:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787582906.411933:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787582906.411971:0:14347:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787582906.411985:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582906.411988:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582906.411989:0:14347:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787582906.411991:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787582906.411994:0:14347:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787582906.411997:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582906.411998:0:14347:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787582906.412000:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787582906.412005:0:14347:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.120@tcp to nid 0x20000c0a8ce78 (192.168.206.120@tcp) 00000020:01000000:1.0:1787582906.412029:0:14347:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787582906.412032:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787582906.412045:0:14347:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8da589c28000) 00000020:00000080:1.0:1787582906.412058:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787582906.412064:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787582906.412115:0:14347:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787582906.412121:0:14347:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787582906.412126:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa113d808b7538cc8 00010000:00080000:1.0:1787582906.412171:0:14347:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8da585e3c000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.120@tcp at head 00010000:00010000:1.0:1787582906.412405:0:14347:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787582906.414897:0:14347:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787582906.415800:0:14347:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787582906.419842:0:14347:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787582906.420310:0:14347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787582906.420555:0:14347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787582906.421224:0:14351:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787582906.421229:0:14351:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787582906.422086:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787582906.422098:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787582906.422127:0:14347:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787582906.422145:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa113d808b7538ccf 00000100:00080000:3.0:1787582906.422155:0:14347:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787582906.422159:0:14347:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8da585e3c000 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:3.0:1787582906.422190:0:14347:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5ad9adf80 x1874416186252544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787582906.422218:0:14347:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787582906.422339:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186252544:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787582906.422405:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874416186252544 offset 0 length 520: 4 00000020:01000000:3.0:1787582906.422641:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582906.422645:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582906.422647:0:14347:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787582906.422651:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787582906.422653:0:14347:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1787582906.422655:0:14347:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787582906.422656:0:14347:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787582906.422657:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787582906.422660:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582906.422661:0:14347:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787582906.422664:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787582906.422668:0:14347:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787582906.422671:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582906.422672:0:14347:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787582906.422675:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787582906.422679:0:14347:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.120@tcp to nid 0x20000c0a8ce78 (192.168.206.120@tcp) 00000020:01000000:3.0:1787582906.422699:0:14347:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787582906.422707:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787582906.422718:0:14347:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8da5bf2db370) 00000020:00000080:3.0:1787582906.422730:0:14347:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787582906.422736:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787582906.422806:0:14347:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787582906.422811:0:14347:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787582906.422817:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa113d808b7538cdd 00010000:00080000:3.0:1787582906.422854:0:14347:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8da5a1547800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.120@tcp at head 00010000:00010000:3.0:1787582906.423168:0:14347:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787582906.423362:0:14347:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787582906.423383:0:14347:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787582906.423846:0:14347:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787582906.424265:0:14347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787582906.424439:0:14347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787582906.425307:0:14353:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787582906.425312:0:14353:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787582906.427065:0:14347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787582906.427077:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787582906.427126:0:14347:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787582906.427151:0:14347:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa113d808b7538ce4 00000100:00080000:2.0:1787582906.427165:0:14347:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787582906.427171:0:14347:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8da5a1547800 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:2.0:1787582906.427209:0:14347:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5adbf6d80 x1874416186252672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787582906.427275:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186252672:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787582906.427343:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874416186252672 offset 0 length 520: 4 00000100:00080000:2.0:1787582906.428798:0:14347:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787582906.430387:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582906.430394:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582906.430396:0:14347:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787582906.430399:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582906.430402:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582906.430404:0:14347:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787582906.430407:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787582906.430409:0:14347:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787582906.430411:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787582906.430413:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582906.430415:0:14347:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787582906.430417:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787582906.430419:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787582906.430420:0:14347:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787582906.430424:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787582906.430468:0:14347:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14347:1874416186252800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582906.431062:0:14347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582906.431206:0:14347:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da590ebb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787582906.431725:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186252800 00000100:00100000:1.0:1787582906.431734:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186252800 00000100:00100000:1.0:1787582906.431876:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787582906.431886:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+9:14347:x1874416186252800:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582906.432253:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+9:14347:x1874416186252800:12345-0@lo:502:llog_process_th.0 Request processed in 367us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582906.432261:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787582906.432394:0:14347:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14347:1874416186252800:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787582906.432429:0:14347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582906.432436:0:14347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582906.432438:0:14347:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787582906.432443:0:14347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787582906.433288:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787582906.433446:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787582906.433501:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ee00/0xa113d808b7538c6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538c74 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.433523:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ee00/0xa113d808b7538c6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538c74 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582906.433532:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8da5ad665000 from 1 10000000:01000000:2.0:1787582906.433535:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787582906.433758:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538ceb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.433777:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538ceb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.433789:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538ceb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582906.433810:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186252928:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787582906.433875:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582906.433918:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da586eeda80 going to sleep for 11 seconds 00000100:00100000:1.0:1787582906.434026:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186252928 00000100:00100000:1.0:1787582906.434033:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186252928 00000100:00100000:1.0:1787582906.434073:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787582906.434082:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+9:14311:x1874416186252928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787582906.434093:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582906.434105:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7538cf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538ceb expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582906.434126:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7538cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538ceb expref: 10 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582906.434135:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7538cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538ceb expref: 10 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582906.434144:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6400, rc 0) 00000100:00100000:1.0:1787582906.434198:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+10:14311:x1874416186252928:12345-0@lo:101:mount.lustre.0 Request processed in 116us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582906.434204:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787582906.434288:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186252928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787582906.434301:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538ceb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538cf2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.434309:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538ceb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538cf2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582906.435473:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186253056:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787582906.435806:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582906.435891:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fbacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582906.436084:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186253056 00000100:00100000:1.0:1787582906.436092:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186253056 00000100:00100000:1.0:1787582906.436172:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787582906.436181:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+10:14311:x1874416186253056:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787582906.436197:0:14321:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787582906.436203:0:14321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787582906.436281:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+10:14311:x1874416186253056:12345-0@lo:256:mount.lustre.0 Request processed in 101us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582906.436288:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787582906.436377:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186253056:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787582906.436989:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787582906.437010:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538ceb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538cf2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.437020:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538ceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538cf2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582906.437028:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da5ad665000 from 1 10000000:01000000:3.0:1787582906.437031:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787582906.437060:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0c00/0xa113d808b7538cf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.437067:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0c00/0xa113d808b7538cf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.437076:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0c00/0xa113d808b7538cf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582906.437092:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186253184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787582906.437122:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582906.437863:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fbacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582906.437942:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186253184 00000100:00100000:0.0:1787582906.437950:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186253184 00000100:00100000:0.0:1787582906.437982:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787582906.437991:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+10:14311:x1874416186253184:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787582906.438015:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582906.438029:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5c20ef800/0xa113d808b7538d00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538cf9 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.438048:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5c20ef800/0xa113d808b7538d00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538cf9 expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.438058:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5c20ef800/0xa113d808b7538d00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538cf9 expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.438066:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ef800, rc 0) 00000100:00100000:0.0:1787582906.438111:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+11:14311:x1874416186253184:12345-0@lo:101:mount.lustre.0 Request processed in 121us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582906.438117:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787582906.438258:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186253184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787582906.438271:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0c00/0xa113d808b7538cf9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d00 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.438281:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0c00/0xa113d808b7538cf9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538d00 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582906.438368:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186253312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787582906.438399:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582906.438415:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fbacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582906.438464:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186253312 00000100:00100000:0.0:1787582906.438468:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186253312 00000100:00100000:0.0:1787582906.438487:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787582906.438493:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+11:14311:x1874416186253312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787582906.439151:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+11:14311:x1874416186253312:12345-0@lo:501:mount.lustre.0 Request processed in 656us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582906.439159:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787582906.439348:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186253312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787582906.439383:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186253440:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787582906.439424:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582906.439443:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fbacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582906.439495:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186253440 00000100:00100000:0.0:1787582906.439501:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186253440 00000100:00100000:0.0:1787582906.439769:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787582906.439778:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+11:14311:x1874416186253440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787582906.439950:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+11:14311:x1874416186253440:12345-0@lo:503:mount.lustre.0 Request processed in 173us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582906.439966:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787582906.440134:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186253440:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787582906.440313:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14355:1874416186253568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582906.440370:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582906.440574:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fbacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582906.440794:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186253568 00000100:00100000:1.0:1787582906.440800:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186253568 00000100:00100000:1.0:1787582906.440827:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787582906.440846:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+11:14355:x1874416186253568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582906.441071:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+11:14355:x1874416186253568:12345-0@lo:502:llog_process_th.0 Request processed in 235us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582906.441078:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787582906.441233:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14355:1874416186253568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787582906.441257:0:14355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582906.441266:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582906.441268:0:14355:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787582906.441276:0:14355:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8da5ad665000 00000020:00000080:3.0:1787582906.441278:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787582906.441285:0:14355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582906.441288:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582906.441289:0:14355:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787582906.441291:0:14355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582906.441293:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582906.441294:0:14355:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787582906.441297:0:14355:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8da5ad665000 00000020:00000080:3.0:1787582906.441299:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787582906.441403:0:14355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582906.441407:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582906.441408:0:14355:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787582906.441411:0:14355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582906.441414:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582906.441415:0:14355:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787582906.441418:0:14355:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8da5ad665000 00000020:00000080:3.0:1787582906.441420:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787582906.441456:0:14355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14355:1874416186253696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582906.441492:0:14355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582906.441523:0:14355:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a4a5bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787582906.443718:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186253696 00000100:00100000:0.0:1787582906.443730:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186253696 00000100:00100000:0.0:1787582906.443780:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787582906.443791:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+11:14355:x1874416186253696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787582906.444119:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+11:14355:x1874416186253696:12345-0@lo:502:llog_process_th.0 Request processed in 329us (2625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582906.444127:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787582906.444370:0:14355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14355:1874416186253696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787582906.444407:0:14355:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582906.444415:0:14355:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582906.444417:0:14355:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787582906.444422:0:14355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787582906.444478:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787582906.444494:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787582906.444564:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0c00/0xa113d808b7538cf9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d00 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.444710:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0c00/0xa113d808b7538cf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d00 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582906.445695:0:14311:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787582906.445699:0:14311:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8da5ad665000 10000000:01000000:3.0:1787582906.445703:0:14311:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8da5ad665000 10000000:01000000:3.0:1787582906.445706:0:14311:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787582906.445712:0:14311:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8da5ad665000 from 1 10000000:01000000:3.0:1787582906.445714:0:14311:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787582906.445751:0:14311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0a00/0xa113d808b7538d07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.445762:0:14311:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0a00/0xa113d808b7538d07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.445771:0:14311:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0a00/0xa113d808b7538d07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582906.445794:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186253824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787582906.445858:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582906.445889:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a0640d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787582906.446066:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186253824 00000100:00100000:0.0:1787582906.446072:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186253824 00000100:00100000:0.0:1787582906.446105:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787582906.446112:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+11:14311:x1874416186253824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787582906.446124:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582906.446136:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5c20eea00/0xa113d808b7538d0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538d07 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.446159:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5c20eea00/0xa113d808b7538d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538d07 expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.446169:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5c20eea00/0xa113d808b7538d0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538d07 expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.446177:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20eea00, rc 0) 00000100:00100000:0.0:1787582906.446221:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14311:x1874416186253824:12345-0@lo:101:mount.lustre.0 Request processed in 108us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582906.446227:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787582906.446339:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186253824:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787582906.446354:0:14311:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0a00/0xa113d808b7538d07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d0e expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.446363:0:14311:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0a00/0xa113d808b7538d07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538d0e expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582906.446408:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186253952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787582906.446433:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582906.446449:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a0640d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582906.446737:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186253952 00000100:00100000:2.0:1787582906.446743:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186253952 00000100:00100000:3.0:1787582906.452155:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787582906.452176:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14311:x1874416186253952:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787582906.457223:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14311:x1874416186253952:12345-0@lo:501:mount.lustre.0 Request processed in 5047us (10781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582906.457235:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787582906.457290:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186253952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787582906.457357:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186254080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787582906.457400:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582906.457577:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a0640d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787582906.457605:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186254080 00000100:00100000:3.0:1787582906.457612:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186254080 00000100:00100000:3.0:1787582906.457655:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787582906.457665:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14311:x1874416186254080:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787582906.458608:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14311:x1874416186254080:12345-0@lo:503:mount.lustre.0 Request processed in 940us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582906.458618:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787582906.458684:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186254080:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787582906.459821:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14359:1874416186254208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582906.459894:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582906.459940:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da586eed240 going to sleep for 11 seconds 00000100:00100000:3.0:1787582906.460051:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186254208 00000100:00100000:3.0:1787582906.460057:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186254208 00000100:00100000:3.0:1787582906.460101:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787582906.460110:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14359:x1874416186254208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787582906.460350:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14359:x1874416186254208:12345-0@lo:502:llog_process_th.0 Request processed in 240us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582906.460358:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787582906.461760:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14359:1874416186254208:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787582906.461846:0:14359:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787582906.461862:0:14359:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8da589c2b370) 00000020:00000080:1.0:1787582906.461883:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787582906.461977:0:14359:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8da5ad665000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787582906.461981:0:14359:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8da5ad665000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787582906.461983:0:14359:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8da5ad665000 4 00010000:00080000:1.0:1787582906.462013:0:14359:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8da5bf45a000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.120@tcp at head 00010000:00010000:1.0:1787582906.464402:0:14359:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1787582906.465297:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787582906.465352:0:14359:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787582906.465365:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa113d808b7538d1c 00000100:00080000:1.0:1787582906.465375:0:14359:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787582906.465380:0:14359:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8da5bf45a000 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:1.0:1787582906.465433:0:14359:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da482a99c00 x1874416186254336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787582906.465467:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874416186254336:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787582906.465552:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787582906.466342:0:14359:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787582906.472806:0:14359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14359:1874416186254464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787582906.472891:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582906.472946:0:14359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da48364e300 going to sleep for 11 seconds 00000100:00100000:2.0:1787582906.473305:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186254464 00000100:00100000:2.0:1787582906.473312:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186254464 00000100:00100000:2.0:1787582906.473382:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787582906.473461:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186254336 00000100:00100000:1.0:1787582906.473466:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186254336 00000100:00100000:1.0:1787582906.473491:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582906.473496:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874416186254336:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787582906.474003:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14359:x1874416186254464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787582906.474242:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14359:x1874416186254464:12345-0@lo:502:llog_process_th.0 Request processed in 851us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582906.474250:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787582906.474518:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874416186254336:12345-0@lo:38:llog_process_th.0 Request processed in 66us (8012us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787582906.474527:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582906.474752:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787582906.474760:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5bf45a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787582906.474765:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787582906.474768:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874416186254336:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787582906.474800:0:14359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14359:1874416186254464:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787582906.474840:0:14359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787582906.475016:0:14311:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787582906.475038:0:14311:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787582906.475055:0:14311:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0a00/0xa113d808b7538d07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d0e expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.475065:0:14311:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0a00/0xa113d808b7538d07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d0e expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787582906.475117:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787582906.475119:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787582906.475121:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582906.475122:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582906.475123:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582906.475125:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582906.475126:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787582906.475127:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787582906.475129:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582906.475130:0:14311:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787582906.475134:0:14311:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787582906.475136:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787582906.475137:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787582906.475138:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582906.475139:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582906.475140:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582906.475141:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582906.475142:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787582906.475143:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787582906.475144:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582906.475145:0:14311:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787582906.475163:0:14311:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787582906.475177:0:14311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186254592:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787582906.475217:0:14311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582906.475242:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186254592 00000100:00100000:3.0:1787582906.475249:0:14311:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5887923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582906.475252:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186254592 00000100:00100000:0.0:1787582906.475283:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787582906.475291:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14311:x1874416186254592:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787582906.475311:0:14321:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787582906.475340:0:14321:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787582906.610660:0:14321:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787582906.610682:0:14321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787582906.611388:0:14345:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787582906.611393:0:14345:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787582906.611415:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d23 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.611503:0:14345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7538cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538ceb expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.611519:0:14345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d23 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.611556:0:14345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7538cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7538ceb expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.611571:0:14345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7538cf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7538ceb expref: 12 pid: 14324 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582906.611586:0:14345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14345:1874416186254720:0@lo:104: 00000100:00100000:2.0:1787582906.611646:0:14345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582906.611800:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186254720 00000100:00100000:3.0:1787582906.611808:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186254720 00000100:00100000:3.0:1787582906.611857:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787582906.611881:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+3:14345:x1874416186254720:12345-0@lo:104: 00010000:00010000:3.0:1787582906.611893:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538ceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7538cf2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.611939:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787582906.611951:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+3:14345:x1874416186254720:12345-0@lo:104: Request processed in 73us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582906.611958:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787582906.611978:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582906.611984:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538ceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7538cf2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.611991:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9f000 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1787582906.611995:0:14318:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538ceb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7538cf2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.612003:0:14318:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7538cf2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582906.612010:0:14318:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7538cf2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582906.612016:0:14318:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787582906.612041:0:14318:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538ceb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538cf2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.612047:0:14318:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582906.612076:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538ceb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538cf2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.612083:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538ceb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538cf2 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582906.612096:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582906.612098:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582906.612100:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582906.612130:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787582906.612140:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3313:1874416186254848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787582906.612169:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582906.612292:0:14345:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da586eed480 going to sleep for 11 seconds 00000100:00100000:2.0:1787582906.612312:0:14345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14345:1874416186254720:0@lo:104: 00010000:00010000:2.0:1787582906.612364:0:14345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d23 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582906.612474:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186254848 00000100:00100000:0.0:1787582906.612479:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186254848 00010000:00010000:0.0:1787582906.612498:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7538cf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7538ceb expref: 13 pid: 14324 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582906.612532:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787582906.612539:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+13:3313:x1874416186254848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787582906.612548:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582906.612553:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7538cf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7538ceb expref: 13 pid: 14324 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.612578:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7538cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7538ceb expref: 13 pid: 14324 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.612593:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5bb6b6400/0xa113d808b7538cf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7538ceb expref: 13 pid: 14324 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.612605:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d23 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.612612:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d23 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787582906.612625:0:14314:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001232678s 00010000:00010000:0.0:1787582906.612629:0:14314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d23 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.612643:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d23 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.612650:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d23 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.612657:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d23 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.612662:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9e000 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582906.612666:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d23 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.612672:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d23 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.612685:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d23 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582906.612694:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582906.612723:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:3313:x1874416186254848:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582906.612730:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787582906.613629:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3313:1874416186254848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787582906.615015:0:14345:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d23 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.615029:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d23 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582906.615036:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d23 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582906.637108:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+11:14311:x1874416186254592:12345-0@lo:253:mount.lustre.0 Request processed in 161808us (161881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582906.637123:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787582906.637768:0:14311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14311:1874416186254592:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787582906.637784:0:14311:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787582906.637787:0:14311:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787582906.637789:0:14311:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787582906.637790:0:14311:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582906.637791:0:14311:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582906.637792:0:14311:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582906.637794:0:14311:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582906.637795:0:14311:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787582906.637797:0:14311:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787582906.637798:0:14311:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582906.637799:0:14311:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787582906.637812:0:14311:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787582906.655562:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787582906.659828:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787582906.661529:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787582906.664300:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787582906.670461:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787582906.670756:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787582906.677274:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787582906.677485:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787582906.677963:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787582906.678140:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787582906.679541:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787582906.680155:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787582906.723281:0:14311:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1787582906.723717:0:14311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1787582906.723962:0:14368:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787582906.723966:0:14368:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1787582906.726773:0:14311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787582906.726933:0:14311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1787582906.727499:0:14369:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1787582906.727567:0:14369:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787582906.729615:0:14369:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787582906.729684:0:14369:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787582906.729688:0:14369:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:3.0:1787582906.730160:0:14311:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787582906.730174:0:14311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787582906.730470:0:14311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787582906.734045:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787582906.734637:0:14311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787582906.734683:0:14311:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787582906.737683:0:14311:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787582906.745058:0:14311:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787582906.774027:0:14311:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787582906.774062:0:14311:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9ec641bd7988 00100000:10000000:1.0:1787582906.774070:0:14311:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787582906.774788:0:14311:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787582906.774816:0:14311:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787582906.774846:0:14311:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787582906.774869:0:14311:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787582907.088755:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787582907.541287:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787582907.984927:0:14326:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787582907.984935:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8da5ad665000 from 6 10000000:01000000:3.0:1787582907.984940:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787582907.984991:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538d2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582907.985004:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538d2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582907.985016:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538d2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582907.985041:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186254976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787582907.985108:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582907.985167:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5835919c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582907.986500:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186254976 00000100:00100000:2.0:1787582907.986512:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186254976 00000100:00100000:2.0:1787582907.986578:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787582907.986587:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+11:14326:x1874416186254976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582907.986603:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582907.986621:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538d2a expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582907.986645:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538d2a expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582907.986655:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538d2a expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582907.986664:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9e000, rc 0) 00000100:00100000:2.0:1787582907.986732:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14326:x1874416186254976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582907.986739:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787582907.987058:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186254976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582907.987087:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538d2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d31 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582907.987096:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538d2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538d31 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582907.987156:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186255104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787582907.987192:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582907.987234:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5835919c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582907.987489:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186255104 00000100:00100000:2.0:1787582907.987500:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186255104 00000100:00100000:2.0:1787582907.987536:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787582907.987544:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14326:x1874416186255104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787582907.987558:0:14321:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787582907.987571:0:14321:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787582907.987574:0:14321:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787582907.987650:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14326:x1874416186255104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582907.987657:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787582907.987949:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186255104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787582907.987997:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787582907.988004:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538d2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d31 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582907.988012:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538d2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d31 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582908.118500:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787582908.570855:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787582909.142395:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582910.161803:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582911.184883:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787582911.501907:0:14612:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg620-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787582911.571691:0:12709:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787582911.571697:0:12709:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787582911.571700:0:12709:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787582911.571702:0:12709:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787582911.571705:0:12709:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787582911.571708:0:12709:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787582911.571711:0:12709:0:(import.c:65:import_set_state_nolock()) ffff8da5bf45a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787582911.571722:0:12709:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8da5bf45a000 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:3.0:1787582911.571740:0:12709:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5ad9ace00 x1874416186255360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787582911.571777:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787582911.571788:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3312:1874416186255232:0@lo:400:kworker.0 00000100:00100000:3.0:1787582911.571860:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582911.571925:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186255232 00000100:00100000:3.0:1787582911.571932:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186255232 00000100:00100000:3.0:1787582911.571971:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787582911.571980:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:3312:x1874416186255232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582911.572023:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:3312:x1874416186255232:12345-0@lo:400:kworker.0 Request processed in 44us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582911.572031:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787582911.572079:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3312:1874416186255232:0@lo:400:kworker.0 00000100:00100000:2.0:1787582911.572239:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874416186255360:0@lo:38:kworker.0 00000100:00100000:2.0:1787582911.572273:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582911.572360:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186255360 00000100:00100000:3.0:1787582911.572365:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186255360 00000100:00100000:3.0:1787582911.572382:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787582911.572387:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874416186255360:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787582911.572417:0:14331:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:3.0:1787582911.572447:0:14331:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa113d808b7538d38 00000004:00100000:3.0:1787582911.572460:0:14331:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787582911.572590:0:14331:0:(import.c:65:import_set_state_nolock()) ffff8da5bbb7c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787582911.572627:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874416186255360:12345-0@lo:38:kworker.0 Request processed in 239us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582911.572633:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787582911.572852:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8da5ad9ace00 x1874416186255360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787582921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787582911.572865:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787582911.572872:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787582911.572876:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787582911.572878:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5bf45a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787582911.572883:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874416186255360:0@lo:38:kworker.0 00010000:00010000:0.0:1787582912.213352:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582913.234204:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582914.256507:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787582915.017605:0:14762:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdce683c70 20000000:00000080:0.0:1787582915.017629:0:14762:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8da5bcd18800 uarg=0000000000000000 20000000:01000000:0.0:1787582915.017673:0:14762:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787582915.017682:0:14762:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787582915.017688:0:14762:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787582915.018548:0:14763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1787582915.018735:0:14762:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787582915.024117:0:14762:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787582915.024160:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d3f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.024184:0:14762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5c20ef800/0xa113d808b7538d00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538cf9 expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.024194:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d3f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.024253:0:14762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5c20ef800/0xa113d808b7538d00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7538cf9 expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.024272:0:14762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da5c20ef800/0xa113d808b7538d00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7538cf9 expref: 11 pid: 14324 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582915.024291:0:14762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad933480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14762:1874416186255488:0@lo:104: 00000100:00100000:0.0:1787582915.024413:0:14762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582915.024489:0:14762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da48364ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787582915.024627:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186255488 00000100:00100000:1.0:1787582915.024638:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186255488 00000100:00100000:1.0:1787582915.024698:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582915.024710:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad931f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+3:14762:x1874416186255488:12345-0@lo:104: 00010000:00010000:1.0:1787582915.024727:0:14313:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0c00/0xa113d808b7538cf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7538d00 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582915.024818:0:14313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787582915.024825:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad931f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+3:14762:x1874416186255488:12345-0@lo:104: Request processed in 117us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582915.024832:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787582915.024860:0:14762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad933480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14762:1874416186255488:0@lo:104: 00010000:00010000:0.0:1787582915.024882:0:14762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d3f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582915.024925:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582915.024934:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0c00/0xa113d808b7538cf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7538d00 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582915.024942:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0c00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1787582915.024946:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0c00/0xa113d808b7538cf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7538d00 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582915.024978:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0c00/0xa113d808b7538cf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7538d00 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582915.024986:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0c00/0xa113d808b7538cf9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7538d00 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582915.024993:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787582915.025027:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0c00/0xa113d808b7538cf9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538d00 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582915.025035:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582915.025060:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0c00/0xa113d808b7538cf9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538d00 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582915.025067:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0c00/0xa113d808b7538cf9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538d00 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582915.025074:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3312:1874416186255616:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787582915.025092:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582915.025096:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582915.025099:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582915.025119:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582915.025157:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186255616 00000100:00100000:0.0:1787582915.025163:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186255616 00010000:00010000:0.0:1787582915.025189:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5c20ef800/0xa113d808b7538d00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7538cf9 expref: 12 pid: 14324 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582915.025219:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787582915.025228:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:3312:x1874416186255616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787582915.025251:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582915.025258:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5c20ef800/0xa113d808b7538d00 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7538cf9 expref: 12 pid: 14324 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.025271:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5c20ef800/0xa113d808b7538d00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7538cf9 expref: 12 pid: 14324 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.025286:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5c20ef800/0xa113d808b7538d00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7538cf9 expref: 12 pid: 14324 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.025303:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d3f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.025312:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d3f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.025365:0:14314:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d3f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.025375:0:14314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d3f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.025383:0:14314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d3f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.025390:0:14314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d3f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.025396:0:14314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee400 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582915.025402:0:14314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d3f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.025422:0:14314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d3f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.025443:0:14314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d3f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582915.025455:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787582915.025474:0:14762:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d3f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582915.025485:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d3f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582915.025505:0:14762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d3f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582915.025624:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+11:3312:x1874416186255616:12345-0@lo:103:ldlm_bl.0 Request processed in 397us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582915.025633:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582915.025695:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3312:1874416186255616:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787582915.281164:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582916.306069:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787582916.433536:0:14326:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787582916.433543:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da5ad665000 from 10 10000000:01000000:0.0:1787582916.433548:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787582916.433594:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7538d46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582916.433606:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7538d46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582916.433617:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7538d46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582916.433640:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad933480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186255744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787582916.433703:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582916.433759:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da48364ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787582916.434201:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186255744 00000100:00100000:1.0:1787582916.434209:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186255744 00000100:00100000:1.0:1787582916.434261:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787582916.434269:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+11:14326:x1874416186255744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582916.434282:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582916.434295:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5bb6b6e00/0xa113d808b7538d4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538d46 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.434409:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5bb6b6e00/0xa113d808b7538d4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538d46 expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.434421:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5bb6b6e00/0xa113d808b7538d4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538d46 expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582916.434430:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6e00, rc 0) 00000100:00100000:1.0:1787582916.434679:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14326:x1874416186255744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 410us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582916.434686:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787582916.434810:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad933480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186255744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787582916.434825:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7538d46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d4d expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582916.434835:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7538d46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538d4d expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582916.434889:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186255872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582916.434930:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.434961:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da589db39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582916.435198:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186255872 00000100:00100000:1.0:1787582916.435203:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186255872 00000100:00100000:1.0:1787582916.435233:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787582916.435240:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14326:x1874416186255872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582916.437053:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14326:x1874416186255872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1807us (2117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582916.437064:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787582916.437538:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186255872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582916.437583:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186256000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787582916.437630:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582916.437664:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da589db39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582916.438502:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186256000 00000100:00100000:1.0:1787582916.438510:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186256000 00000100:00100000:1.0:1787582916.438548:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787582916.438565:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14326:x1874416186256000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582916.438737:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:14326:x1874416186256000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582916.438746:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787582916.443542:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186256000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787582916.445990:0:14824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787582916.446134:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787582916.446151:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787582916.446161:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7538d46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d4d expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582916.446174:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7538d46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d4d expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582916.688958:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787582906/real 1787582906] req@ffff8da5adbf6d80 x1874416186252672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787582916 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582916.688990:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8da5adbf6d80 x1874416186252672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787582916 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582916.689001:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787582906/real 1787582906] req@ffff8da5ad9adf80 x1874416186252544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787582916 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582916.689012:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8da5ad9adf80 x1874416186252544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787582916 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787582916.689029:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5a1547800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787582916.689036:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787582916.689040:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186252672:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787582916.689046:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da585e3c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787582916.689066:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787582916.689069:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186252544:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787582916.689371:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787582916.689564:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787582916.689567:0:38:0:(import.c:65:import_set_state_nolock()) ffff8da585e3c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787582916.689579:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 447 00000100:00080000:0.0:1787582916.689583:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787582916.689589:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8da585e3c000 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:0.0:1787582916.689621:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5ad933800 x1874416186256128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787582916.689646:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787582916.689650:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787582916.689652:0:38:0:(import.c:65:import_set_state_nolock()) ffff8da5a1547800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787582916.689655:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 447 00000100:00080000:0.0:1787582916.689657:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787582916.689661:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8da5a1547800 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:0.0:1787582916.689674:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5ad931500 x1874416186256256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787582916.689791:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186256384:0@lo:400:kworker.0 00000100:00100000:1.0:1787582916.689852:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582916.690100:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186256384 00000100:00100000:0.0:1787582916.690107:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186256384 00000100:00100000:0.0:1787582916.690150:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787582916.690158:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186256384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582916.690209:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186256384:12345-0@lo:400:kworker.0 Request processed in 52us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582916.690216:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787582916.690291:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8da5ad930a80 x1874416186256384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582916.690304:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186256384:0@lo:400:kworker.0 00000100:00100000:3.0:1787582916.690698:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186256128:0@lo:8:kworker.0 00000400:00000100:3.0:1787582916.690727:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874416186256128 offset 0 length 520: 4 00000100:00100000:3.0:1787582916.691550:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186256256:0@lo:8:kworker.0 00000400:00000100:3.0:1787582916.691582:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874416186256256 offset 0 length 520: 4 00010000:00010000:0.0:1787582917.329602:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582918.355415:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787582918.801380:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787582919.377394:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582920.403854:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787582921.350795:0:15011:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787582921.350799:0:15011:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787582921.350902:0:15011:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8da5bf27a800 00000020:01000004:2.0:1787582921.350917:0:15011:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787582921.350928:0:15011:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787582921.350941:0:15011:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8da5b5023370) 00000020:00000080:2.0:1787582921.350955:0:15011:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787582921.383290:0:15011:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787582921.383602:0:15011:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787582921.384259:0:15011:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787582921.384498:0:15011:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787582921.384703:0:15011:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787582921.387769:0:15011:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1787582921.388956:0:15011:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1787582921.389082:0:15011:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1787582921.390005:0:15011:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 595: rc = 0 00100000:10000000:2.0:1787582921.390708:0:15011:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 595: rc = 0 00100000:10000000:2.0:1787582921.390986:0:15011:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 595: rc = 0 00100000:10000000:2.0:1787582921.391909:0:15011:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 595: rc = 0 00100000:10000000:2.0:1787582921.392354:0:15011:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 595: rc = 0 00100000:10000000:2.0:1787582921.392867:0:15011:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 595: rc = 0 00000020:00000080:2.0:1787582921.393958:0:15011:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787582921.393969:0:15011:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787582921.393980:0:15011:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa113d808b7538d5b 00000020:01000004:2.0:1787582921.393997:0:15011:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787582921.394017:0:15011:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.120@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787582921.394020:0:15011:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787582921.394026:0:15011:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787582921.394030:0:15011:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787582921.394048:0:15011:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8da5ade599b8) 00000020:00000080:2.0:1787582921.394058:0:15011:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787582921.397478:0:15011:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787582921.397866:0:15011:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787582921.397873:0:15011:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787582921.402615:0:15011:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787582921.402627:0:15011:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787582921.403001:0:15011:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787582921.403007:0:15011:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787582921.405818:0:15011:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787582921.405992:0:15011:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787582921.405998:0:15011:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787582921.413249:0:15011:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787582921.413262:0:15011:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:1.0:1787582921.424612:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582921.451274:0:15011:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787582921.451652:0:15011:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787582921.451666:0:15011:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787582921.468983:0:15011:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787582921.469003:0:15011:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787582921.478161:0:15011:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787582921.478173:0:15011:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787582921.481103:0:15011:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787582921.481297:0:15011:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787582921.481303:0:15011:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787582921.503973:0:15011:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787582921.503987:0:15011:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787582921.566853:0:15011:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787582921.567048:0:15011:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787582921.567054:0:15011:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787582921.569147:0:15011:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787582921.569158:0:15011:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787582921.574776:0:15011:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787582921.574802:0:15011:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787582921.574809:0:15011:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.120@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787582921.599459:0:15011:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787582921.599526:0:15011:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.120@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787582921.599531:0:15011:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787582921.599533:0:15011:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787582921.599534:0:15011:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582921.599535:0:15011:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582921.599537:0:15011:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582921.599538:0:15011:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582921.599540:0:15011:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787582921.599541:0:15011:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582921.599543:0:15011:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787582921.599546:0:15011:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787582921.599548:0:15011:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787582921.599550:0:15011:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787582921.599551:0:15011:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582921.599552:0:15011:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582921.599553:0:15011:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582921.599554:0:15011:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582921.599555:0:15011:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787582921.599556:0:15011:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582921.599557:0:15011:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787582921.599582:0:15011:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787582921.599602:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186256512:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787582921.599670:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582921.599740:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58565c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582921.599886:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186256512 00000100:00100000:1.0:1787582921.599894:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186256512 00000100:00100000:1.0:1787582921.599937:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787582921.599947:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:15011:x1874416186256512:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787582921.599981:0:14324:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787582921.599985:0:14324:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787582921.599988:0:14324:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787582921.613348:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:15011:x1874416186256512:12345-0@lo:253:mount.lustre.0 Request processed in 13361us (13637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582921.613364:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787582921.613485:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186256512:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787582921.613501:0:15011:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787582921.613504:0:15011:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787582921.613506:0:15011:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787582921.613507:0:15011:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787582921.613508:0:15011:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787582921.613510:0:15011:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787582921.613511:0:15011:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787582921.613513:0:15011:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787582921.613514:0:15011:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787582921.613516:0:15011:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787582921.613535:0:15011:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8da5bf27a800 from lustre-OST0000 10000000:01000000:0.0:1787582921.613563:0:15011:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787582921.613566:0:15011:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787582921.613572:0:15011:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8da5b50219b8 local copy 00010000:00010000:0.0:1787582921.613581:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ea00/0xa113d808b7538c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538c58 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582921.613823:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad930e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186256640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787582921.613861:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582921.613898:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf718840 going to sleep for 11 seconds 00000100:00100000:1.0:1787582921.613959:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186256640 00000100:00100000:1.0:1787582921.613966:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186256640 00000100:00100000:1.0:1787582921.614015:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787582921.614024:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:15011:x1874416186256640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787582921.614173:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:15011:x1874416186256640:12345-0@lo:501:mount.lustre.0 Request processed in 149us (310us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787582921.614180:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787582921.614244:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad930e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186256640:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787582921.614258:0:15011:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787582921.614497:0:15011:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787582921.614504:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ea00/0xa113d808b7538c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538c58 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582921.614523:0:15011:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ea00/0xa113d808b7538c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538c58 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582921.614550:0:15011:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8da5bf27a800 10000000:01000000:2.0:1787582921.614555:0:15011:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787582921.614559:0:15011:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8da5b50219b8 10000000:01000000:2.0:1787582921.614561:0:15011:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787582921.614565:0:15011:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8da5b50219b8 from 1 10000000:01000000:2.0:1787582921.614567:0:15011:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787582921.614594:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f600/0xa113d808b7538d69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582921.614603:0:15011:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f600/0xa113d808b7538d69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582921.614612:0:15011:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f600/0xa113d808b7538d69 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582921.614625:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186256768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787582921.614654:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582921.614674:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58565c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787582921.615602:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186256768 00000100:00100000:0.0:1787582921.615612:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186256768 00000100:00100000:0.0:1787582921.615666:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787582921.615676:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+12:15011:x1874416186256768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787582921.615688:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582921.615704:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5c20ef800/0xa113d808b7538d70 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538d69 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582921.615728:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5c20ef800/0xa113d808b7538d70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538d69 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582921.615761:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5c20ef800/0xa113d808b7538d70 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538d69 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582921.615771:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ef800, rc 0) 00000100:00100000:0.0:1787582921.615894:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+13:15011:x1874416186256768:12345-0@lo:101:mount.lustre.0 Request processed in 219us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582921.615901:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787582921.625445:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186256768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787582921.625480:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f600/0xa113d808b7538d69 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d70 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.625494:0:15011:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f600/0xa113d808b7538d69 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538d70 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582921.625518:0:15011:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787582921.625587:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f600/0xa113d808b7538d69 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d70 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.625617:0:15011:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f600/0xa113d808b7538d69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d70 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582921.625625:0:15011:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787582921.625631:0:15011:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787582921.625636:0:15011:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787582921.625639:0:15011:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787582921.625670:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7538d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.625676:0:15011:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7538d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.625685:0:15011:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7538d77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582921.625703:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186256896:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787582921.625769:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582921.625803:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a8e77180 going to sleep for 11 seconds 00000100:00100000:0.0:1787582921.625876:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186256896 00000100:00100000:0.0:1787582921.625885:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186256896 00000100:00100000:0.0:1787582921.625938:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787582921.625948:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+13:15011:x1874416186256896:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787582921.625960:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582921.625972:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5c20efa00/0xa113d808b7538d7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538d77 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582921.625992:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5c20efa00/0xa113d808b7538d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538d77 expref: 14 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582921.626002:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5c20efa00/0xa113d808b7538d7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538d77 expref: 14 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582921.626010:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20efa00, rc 0) 00000100:00100000:0.0:1787582921.626051:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+14:15011:x1874416186256896:12345-0@lo:101:mount.lustre.0 Request processed in 104us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582921.626058:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787582921.631457:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186256896:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787582921.631486:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7538d77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d7e expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.631499:0:15011:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7538d77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538d7e expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787582921.632179:0:15011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787582921.633206:0:15011:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787582921.633533:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787582921.633578:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787582921.633613:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787582921.633660:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787582921.633697:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787582921.633730:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787582921.633812:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787582921.633820:0:15011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787582921.633896:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257024:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787582921.633958:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582921.634004:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da583489900 going to sleep for 11 seconds 00000100:00100000:1.0:1787582921.634011:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186257024 00000100:00100000:1.0:1787582921.634024:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186257024 00000100:00100000:1.0:1787582921.634074:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787582921.634082:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+14:15011:x1874416186257024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787582921.634458:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+14:15011:x1874416186257024:12345-0@lo:501:mount.lustre.0 Request processed in 375us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582921.634475:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787582921.634661:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787582921.634696:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257152:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787582921.634817:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582921.634904:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fd0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582921.636150:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186257152 00000100:00100000:0.0:1787582921.636162:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186257152 00000100:00100000:0.0:1787582921.636209:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787582921.636219:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+14:15011:x1874416186257152:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787582921.638344:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+14:15011:x1874416186257152:12345-0@lo:503:mount.lustre.0 Request processed in 2119us (3520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582921.638372:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787582921.638958:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257152:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787582921.643048:0:15011:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787582921.643155:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787582921.643228:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582921.643285:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fd0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582921.644148:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186257280 00000100:00100000:3.0:1787582921.644157:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186257280 00000100:00100000:3.0:1787582921.646046:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787582921.646067:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+14:15011:x1874416186257280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787582921.646586:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+14:15011:x1874416186257280:12345-0@lo:502:mount.lustre.0 Request processed in 527us (3356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582921.646594:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787582921.646714:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787582921.647023:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787582921.647080:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787582921.647113:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787582921.647177:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787582921.647214:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787582921.647245:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787582921.647306:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787582921.647400:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787582921.647437:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787582921.647486:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787582921.647523:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787582921.647570:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787582921.647609:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787582921.647660:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582921.647690:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58565ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1787582921.647844:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186257408 00000100:00100000:1.0:1787582921.647851:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186257408 00000100:00100000:1.0:1787582921.647937:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787582921.647946:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+14:15011:x1874416186257408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787582921.648120:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+14:15011:x1874416186257408:12345-0@lo:502:mount.lustre.0 Request processed in 174us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582921.648127:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787582921.650737:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787582921.650899:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787582921.650915:0:15011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787582921.652104:0:15025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787582921.652113:0:15025:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787582921.652119:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582921.652121:0:15025:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787582921.652126:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787582921.652140:0:15025:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8da588590000) 00000020:00000080:0.0:1787582921.652162:0:15025:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787582921.652168:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787582921.652243:0:15025:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8da5bf27a800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787582921.652249:0:15025:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787582921.652256:0:15025:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa113d808b7538d8c 00010000:00010000:0.0:1787582921.667055:0:15025:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1787582921.668009:0:15025:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1787582921.673704:0:15025:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787582921.676516:0:15025:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787582921.676528:0:15025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582921.676534:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582921.676536:0:15025:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787582921.676539:0:15025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787582921.676542:0:15025:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787582921.676544:0:15025:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787582921.676545:0:15025:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787582921.676547:0:15025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787582921.676549:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582921.676551:0:15025:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787582921.676553:0:15025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582921.676557:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582921.676565:0:15025:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787582921.676569:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787582921.676571:0:15025:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787582921.676573:0:15025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582921.676576:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582921.676577:0:15025:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787582921.676579:0:15025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582921.676581:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582921.676582:0:15025:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787582921.676585:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787582921.676642:0:15025:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582921.676645:0:15025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582921.676647:0:15025:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787582921.676650:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787582921.676912:0:15011:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787582921.676938:0:15011:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787582921.676961:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7538d77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d7e expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582921.676973:0:15011:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1200/0xa113d808b7538d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d7e expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582921.676991:0:15011:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da5bf27a800 from 1 10000000:01000000:1.0:1787582921.676994:0:15011:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787582921.677027:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7a00/0xa113d808b7538d93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582921.677034:0:15011:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7a00/0xa113d808b7538d93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582921.677044:0:15011:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7a00/0xa113d808b7538d93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582921.677065:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257536:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787582921.677123:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582921.677152:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fd0240 going to sleep for 11 seconds 00000100:00100000:0.0:1787582921.678493:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186257536 00000100:00100000:0.0:1787582921.678504:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186257536 00000100:00100000:0.0:1787582921.678550:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787582921.678559:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+14:15011:x1874416186257536:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787582921.678573:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582921.678586:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538d93 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582921.678617:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538d93 expref: 15 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582921.678628:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538d93 expref: 15 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582921.678636:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ee400, rc 0) 00000100:00100000:0.0:1787582921.678687:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+15:15011:x1874416186257536:12345-0@lo:101:mount.lustre.0 Request processed in 128us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582921.678693:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787582921.679525:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257536:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787582921.679546:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7a00/0xa113d808b7538d93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d9a expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582921.679556:0:15011:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7a00/0xa113d808b7538d93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538d9a expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787582921.680025:0:15011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787582921.680838:0:15011:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787582921.681074:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787582921.681115:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787582921.681184:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787582921.681192:0:15011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787582921.681255:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257664:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787582921.681311:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582921.684680:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5b4fd0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787582921.692372:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186257664 00000100:00100000:3.0:1787582921.692386:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186257664 00000100:00100000:2.0:1787582921.692611:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787582921.692624:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+15:15011:x1874416186257664:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787582921.692949:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+15:15011:x1874416186257664:12345-0@lo:501:mount.lustre.0 Request processed in 328us (11636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582921.692958:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787582921.693518:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787582921.693567:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787582921.693617:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582921.693655:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf718000 going to sleep for 11 seconds 00000100:00100000:1.0:1787582921.694279:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186257792 00000100:00100000:1.0:1787582921.694286:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186257792 00000100:00100000:1.0:1787582921.694349:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787582921.694365:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+15:15011:x1874416186257792:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787582921.694525:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+15:15011:x1874416186257792:12345-0@lo:503:mount.lustre.0 Request processed in 168us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582921.694533:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787582921.694710:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257792:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787582921.695715:0:15011:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787582921.695803:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787582921.695858:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582921.695887:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da581254cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582921.695999:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186257920 00000100:00100000:0.0:1787582921.696005:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186257920 00000100:00100000:0.0:1787582921.696062:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787582921.696069:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+15:15011:x1874416186257920:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787582921.696224:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+15:15011:x1874416186257920:12345-0@lo:502:mount.lustre.0 Request processed in 154us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582921.696232:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787582921.696638:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186257920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787582921.696885:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787582921.696933:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787582921.696982:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787582921.697027:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787582921.697059:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787582921.697114:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787582921.697153:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787582921.697184:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787582921.697210:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186258048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787582921.697249:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582921.697285:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da581254cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582921.697379:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186258048 00000100:00100000:1.0:1787582921.697384:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186258048 00000100:00100000:1.0:1787582921.697418:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787582921.697426:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+15:15011:x1874416186258048:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787582921.697574:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+15:15011:x1874416186258048:12345-0@lo:502:mount.lustre.0 Request processed in 148us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582921.697582:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787582921.700654:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186258048:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787582921.700842:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787582921.700868:0:15011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787582921.708471:0:15029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582921.708485:0:15029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582921.708487:0:15029:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787582921.708493:0:15029:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8da5bf27a800 00000020:00000080:1.0:1787582921.708496:0:15029:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787582921.708502:0:15029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582921.708504:0:15029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582921.708506:0:15029:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787582921.708508:0:15029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582921.708510:0:15029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582921.708512:0:15029:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787582921.708514:0:15029:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8da5bf27a800 00000020:00000080:1.0:1787582921.708516:0:15029:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787582921.708577:0:15029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582921.708580:0:15029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582921.708581:0:15029:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787582921.708584:0:15029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787582921.708587:0:15029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582921.708588:0:15029:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787582921.708591:0:15029:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8da5bf27a800 00000020:00000080:1.0:1787582921.708593:0:15029:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787582921.708625:0:15029:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787582921.708627:0:15029:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787582921.708629:0:15029:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787582921.708632:0:15029:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787582921.714499:0:15011:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787582921.714538:0:15011:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787582921.714570:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7a00/0xa113d808b7538d93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d9a expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.714582:0:15011:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7a00/0xa113d808b7538d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538d9a expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582921.714632:0:15011:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787582921.714635:0:15011:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8da5bf27a800 10000000:01000000:3.0:1787582921.714638:0:15011:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8da5bf27a800 10000000:01000000:3.0:1787582921.714642:0:15011:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787582921.714647:0:15011:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8da5bf27a800 from 1 10000000:01000000:3.0:1787582921.714649:0:15011:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787582921.714680:0:15011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1a00/0xa113d808b7538da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.714689:0:15011:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1a00/0xa113d808b7538da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.714709:0:15011:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1a00/0xa113d808b7538da1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582921.714732:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186258176:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787582921.714804:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582921.714841:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da581254600 going to sleep for 11 seconds 00000100:00100000:1.0:1787582921.715165:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186258176 00000100:00100000:1.0:1787582921.715172:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186258176 00000100:00100000:1.0:1787582921.715213:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787582921.715221:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+15:15011:x1874416186258176:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787582921.715233:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582921.715245:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5bb6b6000/0xa113d808b7538da8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538da1 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582921.715266:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5bb6b6000/0xa113d808b7538da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538da1 expref: 16 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582921.715275:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5bb6b6000/0xa113d808b7538da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538da1 expref: 16 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582921.715283:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5bb6b6000, rc 0) 00000100:00100000:1.0:1787582921.715341:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:15011:x1874416186258176:12345-0@lo:101:mount.lustre.0 Request processed in 120us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582921.715347:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787582921.718464:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186258176:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787582921.718492:0:15011:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1a00/0xa113d808b7538da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538da8 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.718505:0:15011:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1a00/0xa113d808b7538da1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538da8 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787582921.719092:0:15011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1787582921.719390:0:15011:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787582921.719687:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787582921.719732:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787582921.719803:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787582921.719873:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787582921.719910:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787582921.719957:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787582921.719993:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787582921.720028:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787582921.720078:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787582921.720118:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787582921.720151:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787582921.720193:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787582921.720223:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787582921.720255:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787582921.720343:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787582921.720382:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787582921.720416:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787582921.720462:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787582921.720499:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787582921.720548:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787582921.720598:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787582921.720634:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787582921.720670:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787582921.720735:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787582921.720788:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787582921.720825:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787582921.720870:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787582921.720905:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787582921.720972:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787582921.720979:0:15011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787582921.744777:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186258304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787582921.744844:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582921.748170:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a052f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787582921.755765:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186258304 00000100:00100000:0.0:1787582921.755780:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186258304 00000100:00100000:0.0:1787582921.755843:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787582921.755852:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:15011:x1874416186258304:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787582921.756146:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:15011:x1874416186258304:12345-0@lo:501:mount.lustre.0 Request processed in 294us (11301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582921.756154:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787582921.756989:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186258304:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787582921.757047:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186258432:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787582921.757104:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582921.757133:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a052f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787582921.757524:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186258432 00000100:00100000:0.0:1787582921.757531:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186258432 00000100:00100000:0.0:1787582921.757583:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787582921.757592:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:15011:x1874416186258432:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787582921.757814:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:15011:x1874416186258432:12345-0@lo:503:mount.lustre.0 Request processed in 223us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582921.757822:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787582921.765871:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186258432:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787582921.766668:0:15011:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787582921.766744:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186258560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787582921.766825:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582921.766903:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da581254600 going to sleep for 11 seconds 00000100:00100000:2.0:1787582921.770732:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186258560 00000100:00100000:2.0:1787582921.770768:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186258560 00000100:00100000:2.0:1787582921.770874:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787582921.770886:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:15011:x1874416186258560:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787582921.771158:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:15011:x1874416186258560:12345-0@lo:502:mount.lustre.0 Request processed in 275us (4333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582921.771166:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787582921.771461:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186258560:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787582921.771736:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787582921.771804:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787582921.771840:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787582921.771903:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787582921.771938:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787582921.771995:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787582921.772034:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787582921.772065:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787582921.772114:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787582921.772149:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787582921.772194:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787582921.772254:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787582921.772293:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787582921.772349:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787582921.772396:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787582921.772431:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787582921.772465:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787582921.772511:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787582921.772548:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787582921.772598:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787582921.772661:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787582921.772700:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787582921.772735:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787582921.772798:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787582921.772834:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787582921.772866:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787582921.772914:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787582921.772951:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787582921.772986:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787582921.773035:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787582921.773073:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787582921.773106:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787582921.773137:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787582921.773182:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787582921.773232:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787582921.773290:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787582921.773352:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787582921.773387:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787582921.773434:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787582921.773471:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787582921.773515:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186258688:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787582921.773580:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582921.782985:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da581254600 going to sleep for 11 seconds 00000100:00100000:0.0:1787582921.785470:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186258688 00000100:00100000:0.0:1787582921.785486:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186258688 00000100:00100000:0.0:1787582921.785555:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787582921.785565:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:15011:x1874416186258688:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787582921.785866:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:15011:x1874416186258688:12345-0@lo:502:mount.lustre.0 Request processed in 302us (12285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582921.785875:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787582921.786157:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186258688:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787582921.786265:0:15011:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787582921.786278:0:15011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787582921.789736:0:15034:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787582921.789762:0:15034:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8da5bf2d99b8) 00000020:00000080:3.0:1787582921.789784:0:15034:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1787582921.789872:0:15034:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8da5bf27a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787582921.789877:0:15034:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8da5bf27a800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787582921.789879:0:15034:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8da5bf27a800 3 00010000:00080000:3.0:1787582921.789916:0:15034:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8da584c3c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.120@tcp at head 00010000:00010000:3.0:1787582921.794856:0:15034:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1787582921.795083:0:15034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787582921.795119:0:15034:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787582921.795129:0:15034:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa113d808b7538db6 00000100:00080000:3.0:1787582921.795139:0:15034:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787582921.795144:0:15034:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8da584c3c800 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:3.0:1787582921.795175:0:15034:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5ad9ad500 x1874416186258816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787582921.795204:0:15034:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787582921.795230:0:12709:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787582921.795235:0:12709:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787582921.795237:0:12709:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787582921.795240:0:12709:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787582921.796588:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874416186258816:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787582921.796671:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582921.796733:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582921.796741:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186258944:0@lo:400:kworker.0 00000100:00100000:1.0:1787582921.796779:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582921.797474:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186258816 00000100:00100000:3.0:1787582921.797484:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186258816 00000100:00100000:3.0:1787582921.797517:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186258944 00000100:00100000:3.0:1787582921.797529:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186258944 00000100:00100000:3.0:1787582921.797559:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787582921.797567:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186258944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582921.797625:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186258944:12345-0@lo:400:kworker.0 Request processed in 58us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582921.797632:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787582921.797647:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787582921.797651:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874416186258816:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787582921.797673:0:14329:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:3.0:1787582921.797715:0:14329:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa113d808b7538dbd 00000004:00100000:3.0:1787582921.797729:0:14329:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787582921.797768:0:14329:0:(import.c:65:import_set_state_nolock()) ffff8da589b3f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787582921.797809:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874416186258816:12345-0@lo:38:llog_process_th.0 Request processed in 156us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582921.797816:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787582921.797855:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8da5ad9ad500 x1874416186258816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787582931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582921.797866:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787582921.797874:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787582921.797881:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787582921.797885:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787582921.797888:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da584c3c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787582921.797893:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874416186258816:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787582921.798034:0:15034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787582921.798134:0:15011:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787582921.798161:0:15011:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787582921.798179:0:15011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1a00/0xa113d808b7538da1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538da8 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.798190:0:15011:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1a00/0xa113d808b7538da1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538da8 expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787582921.798234:0:15011:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787582921.798236:0:15011:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787582921.798237:0:15011:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582921.798239:0:15011:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582921.798240:0:15011:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582921.798241:0:15011:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582921.798243:0:15011:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787582921.798245:0:15011:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582921.798246:0:15011:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787582921.798250:0:15011:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787582921.798252:0:15011:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787582921.798253:0:15011:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787582921.798255:0:15011:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582921.798256:0:15011:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582921.798257:0:15011:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582921.798258:0:15011:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582921.798259:0:15011:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787582921.798260:0:15011:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582921.798262:0:15011:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787582921.798277:0:15011:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787582921.798290:0:15011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186259072:0@lo:253:mount.lustre.0 00010000:00080000:1.0:1787582921.798661:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8da5ad9ae300 x1874416186258944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582921.798673:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186258944:0@lo:400:kworker.0 00000100:00100000:3.0:1787582921.798934:0:15011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582921.798965:0:15011:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da581254cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582921.799303:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186259072 00000100:00100000:0.0:1787582921.799310:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186259072 00000100:00100000:0.0:1787582921.799444:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787582921.799454:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf31b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:15011:x1874416186259072:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787582921.799489:0:14324:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787582921.799574:0:14324:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787582921.840637:0:14324:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787582921.840658:0:14324:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787582921.840709:0:14345:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787582921.840714:0:14345:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787582921.840744:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8da5bb6b7e00/0xa113d808b7538dc4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582921.840773:0:14345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538d2a expref: 16 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582921.840781:0:14345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8da5bb6b7e00/0xa113d808b7538dc4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582921.840822:0:14345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7538d2a expref: 16 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582921.840835:0:14345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7538d2a expref: 16 pid: 14323 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582921.840851:0:14345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14345:1874416186259200:0@lo:104: 00000100:00100000:1.0:1787582921.840913:0:14345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582921.840958:0:14345:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf3d9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787582921.841291:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186259200 00000100:00100000:0.0:1787582921.841299:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186259200 00000100:00100000:0.0:1787582921.841375:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787582921.841384:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+3:14345:x1874416186259200:12345-0@lo:104: 00010000:00010000:0.0:1787582921.841396:0:14313:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538d2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7538d31 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582921.841445:0:14313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787582921.841463:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+3:14345:x1874416186259200:12345-0@lo:104: Request processed in 81us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582921.841470:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787582921.841645:0:14345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14345:1874416186259200:0@lo:104: 00010000:00010000:1.0:1787582921.841662:0:14345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8da5bb6b7e00/0xa113d808b7538dc4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.841888:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582921.841895:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538d2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7538d31 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.841903:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0800 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1787582921.841913:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538d2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7538d31 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.841922:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7538d31 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582921.841929:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538d2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7538d31 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582921.841935:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787582921.841964:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538d2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538d31 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.841971:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582921.841988:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538d2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538d31 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.841995:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538d2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538d31 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582921.842011:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582921.842013:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582921.842015:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582921.843633:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3311:1874416186259328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787582921.843690:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582921.844469:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186259328 00000100:00100000:2.0:1787582921.844477:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186259328 00010000:00010000:2.0:1787582921.844516:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7538d2a expref: 17 pid: 14323 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582921.844549:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787582921.844558:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:3311:x1874416186259328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787582921.844571:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582921.844577:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7538d2a expref: 17 pid: 14323 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582921.844591:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7538d2a expref: 17 pid: 14323 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582921.844607:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4d9e000/0xa113d808b7538d31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7538d2a expref: 17 pid: 14323 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582921.844623:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8da5bb6b7e00/0xa113d808b7538dc4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582921.844632:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5bb6b7e00/0xa113d808b7538dc4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787582921.844647:0:14315:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003932759s 00010000:00010000:2.0:1787582921.844663:0:14315:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5bb6b7e00/0xa113d808b7538dc4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582921.844671:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5bb6b7e00/0xa113d808b7538dc4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582921.844678:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8da5bb6b7e00/0xa113d808b7538dc4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582921.844686:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8da5bb6b7e00/0xa113d808b7538dc4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582921.844692:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7e00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582921.844697:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8da5bb6b7e00/0xa113d808b7538dc4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582921.844705:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8da5bb6b7e00/0xa113d808b7538dc4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582921.844721:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8da5bb6b7e00/0xa113d808b7538dc4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582921.844745:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582921.844801:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:3311:x1874416186259328:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582921.844807:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787582921.844850:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3311:1874416186259328:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787582921.844977:0:14345:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8da5bb6b7e00/0xa113d808b7538dc4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582921.844986:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8da5bb6b7e00/0xa113d808b7538dc4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582921.844993:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5bb6b7e00/0xa113d808b7538dc4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582921.889094:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf31b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+15:15011:x1874416186259072:12345-0@lo:253:mount.lustre.0 Request processed in 89634us (90152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582921.889106:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787582921.889206:0:15011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15011:1874416186259072:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787582921.889220:0:15011:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787582921.889223:0:15011:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787582921.889225:0:15011:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787582921.889226:0:15011:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787582921.889227:0:15011:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787582921.889228:0:15011:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787582921.889229:0:15011:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787582921.889231:0:15011:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787582921.889244:0:15011:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787582921.889245:0:15011:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787582921.889257:0:15011:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787582921.902987:0:15011:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787582921.903153:0:15011:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787582921.903299:0:15011:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787582921.904440:0:15011:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787582921.904606:0:15011:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787582921.905678:0:15011:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787582921.914455:0:15011:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787582922.039783:0:15011:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787582922.039791:0:15011:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787582922.039824:0:15011:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787582922.040044:0:15011:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.120@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787582922.040072:0:15011:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787582922.040101:0:15011:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787582922.449624:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787582923.346433:0:14326:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787582923.346443:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8da5ad665000 from 7 10000000:01000000:3.0:1787582923.346450:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787582923.346519:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538dcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582923.346533:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538dcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582923.346546:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538dcb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582923.346579:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186259456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787582923.346674:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582923.346756:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf328780 going to sleep for 11 seconds 00000100:00100000:3.0:1787582923.346786:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186259456 00000100:00100000:3.0:1787582923.346795:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186259456 00000100:00100000:3.0:1787582923.346855:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787582923.346866:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf319c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+15:14326:x1874416186259456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582923.346882:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582923.346898:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5a08d0000/0xa113d808b7538dd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538dcb expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582923.346938:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5a08d0000/0xa113d808b7538dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538dcb expref: 16 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582923.346950:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5a08d0000/0xa113d808b7538dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538dcb expref: 16 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582923.346961:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0000, rc 0) 00000100:00100000:3.0:1787582923.347006:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf319c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:14326:x1874416186259456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582923.347014:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787582923.347096:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186259456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582923.347113:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538dcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538dd2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582923.347124:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538dcb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538dd2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582923.347178:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186259584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787582923.347209:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582923.347222:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf328780 going to sleep for 11 seconds 00000100:00100000:0.0:1787582923.348210:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186259584 00000100:00100000:0.0:1787582923.348222:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186259584 00000100:00100000:0.0:1787582923.348279:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787582923.348290:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:14326:x1874416186259584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787582923.348333:0:14324:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787582923.348359:0:14324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787582923.348362:0:14324:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787582923.348656:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:14326:x1874416186259584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 367us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582923.348664:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787582923.348884:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186259584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787582923.348962:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787582923.348972:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538dcb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538dd2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582923.348983:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538dcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538dd2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582923.472841:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582924.496683:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582925.520496:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582926.548765:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787582926.929141:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787582926.929148:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787582926.929150:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787582926.929153:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787582926.929219:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3312:1874416186259712:0@lo:400:kworker.0 00000100:00100000:0.0:1787582926.929294:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582926.929384:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186259840:0@lo:400:kworker.0 00000100:00100000:0.0:1787582926.929417:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582926.929437:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582926.929443:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186259968:0@lo:400:kworker.0 00000100:00100000:0.0:1787582926.929487:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582926.929766:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186259712 00000100:00100000:0.0:1787582926.929773:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186259712 00000100:00100000:0.0:1787582926.929818:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787582926.929826:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:3312:x1874416186259712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582926.929877:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:3312:x1874416186259712:12345-0@lo:400:kworker.0 Request processed in 52us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582926.929885:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787582926.929928:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186259840 00000100:00100000:0.0:1787582926.929932:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186259840 00000100:00100000:0.0:1787582926.929955:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186259968 00000100:00100000:0.0:1787582926.929958:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186259968 00000100:00100000:0.0:1787582926.929981:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787582926.929987:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186259840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582926.930026:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186259840:12345-0@lo:400:kworker.0 Request processed in 38us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582926.930032:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787582926.930045:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787582926.930051:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186259968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582926.930076:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186259968:12345-0@lo:400:kworker.0 Request processed in 26us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582926.930092:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787582926.930129:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787582926.930158:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5ad931c00 x1874416186259968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582926.930171:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186259968:0@lo:400:kworker.0 00010000:00080000:0.0:1787582926.930181:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5ad931180 x1874416186259840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582926.930189:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186259840:0@lo:400:kworker.0 00000100:00100000:0.0:1787582926.930215:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3312:1874416186259712:0@lo:400:kworker.0 00010000:00010000:2.0:1787582927.568768:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787582928.016912:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787582928.599993:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582929.617089:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787582930.544300:0:15380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg620-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787582930.643819:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582931.031736:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787582916/real 1787582916] req@ffff8da5ad933800 x1874416186256128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787582931 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582931.031771:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8da5ad933800 x1874416186256128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787582931 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582931.031884:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787582916/real 1787582916] req@ffff8da5ad931500 x1874416186256256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787582931 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582931.031912:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8da5ad931500 x1874416186256256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787582931 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787582931.031929:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da585e3c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787582931.031950:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787582931.031954:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186256128:0@lo:8:kworker.0 00000100:00080000:3.0:1787582931.031960:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5a1547800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787582931.031964:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787582931.031967:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186256256:0@lo:8:kworker.0 00000100:00080000:2.0:1787582931.034182:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787582931.034188:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787582931.034191:0:8:0:(import.c:65:import_set_state_nolock()) ffff8da585e3c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787582931.034199:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 457 00000100:00080000:2.0:1787582931.034204:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787582931.034210:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8da585e3c000 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:2.0:1787582931.034230:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5adbf5880 x1874416186260224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787582931.034246:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787582931.034249:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787582931.034251:0:8:0:(import.c:65:import_set_state_nolock()) ffff8da5a1547800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787582931.034254:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 457 00000100:00080000:2.0:1787582931.034257:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787582931.034260:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8da5a1547800 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:2.0:1787582931.034271:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5adbf5c00 x1874416186260352/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787582931.034336:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186260480:0@lo:400:kworker.0 00000100:00100000:2.0:1787582931.034394:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582931.034777:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3311:1874416186260096:0@lo:400:kworker.0 00000100:00100000:0.0:1787582931.034810:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582931.034840:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787582931.034846:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874416186260608:0@lo:400:kworker.0 00000100:00100000:0.0:1787582931.034868:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582931.034899:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186260480 00000100:00100000:0.0:1787582931.034905:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186260480 00000100:00100000:0.0:1787582931.034938:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186260608 00000100:00100000:0.0:1787582931.034941:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186260608 00000100:00100000:0.0:1787582931.034960:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787582931.034966:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186260480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582931.035004:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186260480:12345-0@lo:400:kworker.0 Request processed in 38us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582931.035022:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787582931.035036:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787582931.035041:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874416186260608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582931.035065:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874416186260608:12345-0@lo:400:kworker.0 Request processed in 25us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582931.035070:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787582931.035086:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787582931.035104:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5adbf4e00 x1874416186260608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582931.035117:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874416186260608:0@lo:400:kworker.0 00000100:00100000:0.0:1787582931.038464:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186260224:0@lo:8:kworker.0 00000100:00100000:0.0:1787582931.038544:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582931.038584:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186260352:0@lo:8:kworker.0 00000100:00100000:0.0:1787582931.038607:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582931.038836:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186260224 00000100:00100000:1.0:1787582931.038844:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186260224 00000100:00100000:1.0:1787582931.038873:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186260352 00000100:00100000:1.0:1787582931.038875:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186260352 00000100:00100000:1.0:1787582931.038887:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582931.038893:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874416186260224:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787582931.038938:0:15012:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1787582931.038965:0:15012:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa113d808b7538dd9 00002000:00100000:1.0:1787582931.038979:0:15012:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8da5bb7f1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787582931.038983:0:15012:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787582931.038986:0:15012:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1787582931.039106:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186260096 00000100:00100000:3.0:1787582931.039111:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186260096 00000100:00100000:3.0:1787582931.039145:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787582931.039151:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf31a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:3311:x1874416186260096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582931.039203:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf31a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:3311:x1874416186260096:12345-0@lo:400:kworker.0 Request processed in 52us (4392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582931.039209:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787582931.039256:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3311:1874416186260096:0@lo:400:kworker.0 00002000:00080000:1.0:1787582931.039284:0:15012:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787582931.039306:0:15012:0:(import.c:65:import_set_state_nolock()) ffff8da5bb7f7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582931.039378:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874416186260224:12345-0@lo:8:kworker.0 Request processed in 485us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582931.039385:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787582931.039397:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787582931.039401:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874416186260352:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787582931.039411:0:15012:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1787582931.039556:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5adbf6680 x1874416186260480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582931.039581:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186260480:0@lo:400:kworker.0 00010000:00080000:2.0:1787582931.053616:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5adbf5880 x1874416186260224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787582951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582931.053631:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787582931.053642:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787582931.053652:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787582931.053658:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787582931.053662:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da585e3c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787582931.053693:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787582931.053709:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186260224:0@lo:8:kworker.0 00000004:00080000:0.0:1787582931.053745:0:14351:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787582931.053895:0:14352:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787582931.053917:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14352:1874416186260864:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787582931.053972:0:14352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582931.054006:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf3283c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582931.054017:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787582931.054028:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186260736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787582931.054054:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787582931.054067:0:14351:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 472060748874ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787582931.058064:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874416186260352:12345-0@lo:8:kworker.0 Request processed in 18639us (19434us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787582931.058094:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787582931.058123:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186260864 00000100:00100000:0.0:1787582931.058130:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186260864 00000100:00080000:0.0:1787582931.058157:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787582931.058198:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787582931.058206:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14352:x1874416186260864:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787582931.059075:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186260736 00000100:00100000:2.0:1787582931.059081:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186260736 00000100:00100000:2.0:1787582931.059124:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787582931.059133:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874416186260736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582931.059156:0:15016:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582931.059212:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874416186260736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (5156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582931.059219:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787582931.059275:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5ad9ad500 x1874416186260736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582931.059305:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186260736:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787582931.059369:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5a1547800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787582931.059374:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787582931.059378:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186260352:0@lo:8:kworker.0 00002000:00080000:0.0:1787582931.060558:0:15014:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787582931.060573:0:15014:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787582931.060577:0:15014:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1787582931.087786:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.087798:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538de0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.087815:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.087820:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.087825:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538de0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.087842:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538de0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.087853:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538de0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.087860:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538de0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.087885:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582931.088140:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582931.088149:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538de0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.088160:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7400 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582931.088165:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538de0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.088175:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538de0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.088195:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538de0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.088203:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538de0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.088222:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582931.088225:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582931.088227:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787582931.088384:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.088398:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538de7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.088407:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.088411:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.088416:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538de7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.088427:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538de7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.088436:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538de7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.088443:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538de7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.088464:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787582931.088530:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582931.088537:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538de7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.088545:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6600 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582931.088549:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538de7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.088558:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538de7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.088574:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538de7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.088583:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538de7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.088603:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.088605:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.088607:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787582931.088868:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.088874:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538dee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.088882:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.088885:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.088890:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538dee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.088898:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538dee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.088913:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538dee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.088919:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538dee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.088939:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582931.088959:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582931.088965:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538dee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.088974:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7800 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582931.088977:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538dee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.088993:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538dee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.089008:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538dee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.089015:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538dee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.089033:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582931.089036:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582931.089038:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787582931.089408:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.089414:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538df5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.089422:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.089425:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.089429:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538df5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.089438:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538df5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.089446:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538df5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.089453:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538df5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.089483:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787582931.089515:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582931.089522:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538df5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.089543:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7e00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582931.089548:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538df5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.089557:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538df5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.089571:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538df5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.089579:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538df5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.089596:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.089599:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.089602:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787582931.089900:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.089906:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538dfc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.089914:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.089917:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.089922:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538dfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.089931:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538dfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.089939:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538dfc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.089946:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538dfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.089968:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582931.090046:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582931.090053:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538dfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.090061:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6c00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582931.090066:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538dfc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.090075:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538dfc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.090088:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538dfc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.090107:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538dfc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.090137:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582931.090140:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582931.090143:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787582931.100477:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.100494:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.100514:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.100532:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.100540:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.100554:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.100566:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.100574:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.100846:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787582931.103874:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.103887:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.103902:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.103906:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.103913:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.103926:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.103936:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.103953:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.104306:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787582931.104339:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.104348:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6400 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582931.104352:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.104360:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.104386:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.104393:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.104410:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582931.104413:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.104418:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7600 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582931.104421:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.104427:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.104434:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e0a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.104440:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.104442:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.104444:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582931.109722:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787582931.109742:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.109787:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787582931.110498:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.110507:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.110519:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.110524:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.110530:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.110543:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.110553:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.110560:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.110588:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787582931.113343:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.113358:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.113374:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.113379:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.113385:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.113400:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.113410:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.113417:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.113439:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787582931.113453:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787582931.113458:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.113466:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6a00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:1.0:1787582931.113479:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.113488:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.113504:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e11 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.113511:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.113529:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582931.113532:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.113539:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6200 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:1.0:1787582931.113542:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.113550:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.113559:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e18 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.113567:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.113585:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582931.113588:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582931.113590:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787582931.114203:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.114209:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.114218:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.114222:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.114226:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.114236:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.114244:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.114252:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.114268:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787582931.114277:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582931.114281:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.114298:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7200 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:1.0:1787582931.114302:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.114310:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.114351:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e1f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.114359:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.114373:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582931.114375:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582931.114376:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582931.117286:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787582931.118028:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.118041:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.118058:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.118063:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.118069:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.118083:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.118101:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.118109:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.118182:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787582931.118776:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.118783:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.118793:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.118796:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.118800:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.118809:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.118817:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.118825:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.124221:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787582931.124236:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.124251:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7e00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582931.124256:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.124268:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.124293:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e26 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.124301:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.124350:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582931.124355:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.124362:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6600 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582931.124366:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.124374:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.124393:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e2d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.124402:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582931.124404:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582931.124407:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582931.150895:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787582931.150912:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.150993:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787582931.152934:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.152945:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.152961:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.152965:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.152971:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.152983:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.152992:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.153000:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.153020:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787582931.153477:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.153484:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.153499:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.153502:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.153506:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.153515:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.153524:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.153530:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.153548:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787582931.156636:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787582931.156650:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.156665:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7600 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582931.156670:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.156681:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.156715:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e34 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.156723:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d261ccd6/0xa113d808b7538e34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.156744:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582931.156749:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.156769:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6400 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582931.156773:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.156781:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.156806:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e3b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.156813:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a109b2ad/0xa113d808b7538e3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.156828:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582931.156830:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582931.156832:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.156951:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787582931.160052:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787582931.169215:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.169227:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538e42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.169243:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.169248:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.169253:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538e42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.169267:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538e42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.169288:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538e42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.169295:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538e42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.169349:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787582931.169407:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582931.169416:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538e42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.169426:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6c00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582931.169432:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538e42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.169441:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538e42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.169468:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538e42 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.169476:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094bc8a3d/0xa113d808b7538e42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.169499:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582931.169504:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582931.169506:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787582931.172583:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.172598:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.172614:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.172618:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.172625:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.172639:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.172649:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.172658:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.173690:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787582931.175719:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.175732:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.175748:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.175753:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.175760:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.175774:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.175784:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.175792:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.181221:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787582931.182868:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.182880:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.182905:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.182915:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.182923:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.183668:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787582931.184327:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.184342:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.184351:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.185062:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1787582931.185670:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.185678:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e5e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.185692:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.185708:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.185714:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.185726:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.185736:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.185751:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.185762:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1787582931.186195:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.186200:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538e65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.186208:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.186211:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.186215:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538e65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.186224:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538e65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.186232:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538e65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.186239:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538e65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.186248:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1787582931.186629:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.186635:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538e6c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.186649:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.186652:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.186656:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538e6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.186665:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538e6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.186672:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538e6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.186680:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538e6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.186688:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1787582931.187045:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.187050:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.187058:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.187061:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.187066:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.187074:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.187094:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.187101:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.187109:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1787582931.187471:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.187477:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ff0e7b/0xa113d808b7538e7a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.187485:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.187488:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.187492:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094ff0e7b/0xa113d808b7538e7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.187501:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094ff0e7b/0xa113d808b7538e7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.187508:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094ff0e7b/0xa113d808b7538e7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.187517:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094ff0e7b/0xa113d808b7538e7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.187534:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1787582931.187895:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787582931.187900:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7346bd5/0xa113d808b7538e81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.187909:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=472s v=(0 0) 00010000:00010000:1.0:1787582931.187911:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582931.187915:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7346bd5/0xa113d808b7538e81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.187924:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7346bd5/0xa113d808b7538e81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.188553:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1787582931.188562:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.188570:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7200 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582931.188576:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.188585:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.188602:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e50 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582931.188609:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe366fc9/0xa113d808b7538e50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.188781:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.188796:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6600 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582931.188800:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.188809:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.188820:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e49 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.188827:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c23b5c1/0xa113d808b7538e49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.188898:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787582931.188903:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.188911:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6200 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582931.188914:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.188922:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.189163:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787582931.189282:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e57 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189297:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004299296c/0xa113d808b7538e57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189312:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787582931.189335:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538e65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189342:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7800 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582931.189345:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538e65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189352:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538e65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189362:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538e65 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189369:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000207e18f5/0xa113d808b7538e65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189381:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787582931.189385:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538e6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189390:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7400 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582931.189399:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538e6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189407:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538e6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189417:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538e6c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189424:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd60c37e/0xa113d808b7538e6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189504:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787582931.189508:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189515:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7e00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582931.189519:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189526:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189536:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e73 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189543:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002488289a/0xa113d808b7538e73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189559:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582931.189562:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094ff0e7b/0xa113d808b7538e7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189569:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580030000 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582931.189572:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ff0e7b/0xa113d808b7538e7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189579:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094ff0e7b/0xa113d808b7538e7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189587:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094ff0e7b/0xa113d808b7538e7a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189594:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094ff0e7b/0xa113d808b7538e7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.189605:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.189606:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.189609:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582931.190275:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7346bd5/0xa113d808b7538e81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.190287:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7346bd5/0xa113d808b7538e81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582931.190302:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787582931.195926:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582931.197018:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7346bd5/0xa113d808b7538e81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.197032:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da580030200 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582931.197514:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7346bd5/0xa113d808b7538e81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.197531:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7346bd5/0xa113d808b7538e81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.197552:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7346bd5/0xa113d808b7538e81 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.197558:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7346bd5/0xa113d808b7538e81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.197583:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.197585:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.197587:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787582931.199647:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787582931.199660:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8a9417a/0xa113d808b7538e88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.199676:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1787582931.199680:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582931.199687:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8a9417a/0xa113d808b7538e88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.199712:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8a9417a/0xa113d808b7538e88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.199723:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8a9417a/0xa113d808b7538e88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.199740:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8a9417a/0xa113d808b7538e88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.199810:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787582931.200343:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787582931.200349:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e427bfe/0xa113d808b7538e8f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.200359:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1787582931.200363:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582931.200367:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e427bfe/0xa113d808b7538e8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.200377:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e427bfe/0xa113d808b7538e8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.200385:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e427bfe/0xa113d808b7538e8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.200393:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e427bfe/0xa113d808b7538e8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.205178:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787582931.205192:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8a9417a/0xa113d808b7538e88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.205205:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1e00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582931.205210:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8a9417a/0xa113d808b7538e88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.205222:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8a9417a/0xa113d808b7538e88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.205243:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8a9417a/0xa113d808b7538e88 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.205251:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8a9417a/0xa113d808b7538e88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.205290:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582931.205295:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e427bfe/0xa113d808b7538e8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.205302:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0400 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582931.205305:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e427bfe/0xa113d808b7538e8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.205312:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e427bfe/0xa113d808b7538e8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.205453:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e427bfe/0xa113d808b7538e8f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.205462:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582931.205464:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582931.205466:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582931.205507:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582931.205509:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582931.205511:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.205814:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787582931.205822:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e427bfe/0xa113d808b7538e8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.206126:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.206246:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.206256:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b6a00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582931.206260:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.206269:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.206282:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e5e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.206289:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd019f9b/0xa113d808b7538e5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.206307:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.206309:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.206310:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787582931.207687:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787582931.207708:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebb99f24/0xa113d808b7538e96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.207722:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=472s v=(0 0) 00010000:00010000:3.0:1787582931.207727:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582931.207739:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebb99f24/0xa113d808b7538e96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.207752:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebb99f24/0xa113d808b7538e96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.207762:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebb99f24/0xa113d808b7538e96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.207770:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebb99f24/0xa113d808b7538e96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582931.208218:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787582931.208545:0:15403:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582931.208552:0:15403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebb99f24/0xa113d808b7538e96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.208560:0:15403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1400 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582931.208565:0:15403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebb99f24/0xa113d808b7538e96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.208574:0:15403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebb99f24/0xa113d808b7538e96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.208591:0:15403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebb99f24/0xa113d808b7538e96 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.208598:0:15403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebb99f24/0xa113d808b7538e96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582931.208624:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.208626:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582931.208628:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787582931.208865:0:15014:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1787582931.209223:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14352:x1874416186260864:12345-0@lo:5:osp-pre-0-0.0 Request processed in 151014us (155246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582931.209238:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787582931.209445:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14352:1874416186260864:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787582931.209459:0:14352:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787582931.209496:0:14352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14352:1874416186260992:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787582931.209527:0:14352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582931.209571:0:14352:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf3283c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787582931.209941:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186260992 00000100:00100000:2.0:1787582931.209948:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186260992 00000100:00100000:2.0:1787582931.210109:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787582931.210121:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14352:x1874416186260992:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787582931.210160:0:15013:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1787582931.224644:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14352:x1874416186260992:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14520us (15110us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787582931.224656:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787582931.224971:0:14352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14352:1874416186260992:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787582931.224987:0:14352:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1787582931.666617:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787582932.260059:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787582932.260072:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1787582932.693844:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582933.717252:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582934.736505:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582935.765391:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787582936.154251:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787582936.154258:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787582936.154261:0:8:0:(import.c:65:import_set_state_nolock()) ffff8da5a1547800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787582936.154275:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 472 00000100:00080000:1.0:1787582936.154279:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787582936.154285:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8da5a1547800 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:1.0:1787582936.154307:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da482a99180 x1874416186261376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787582936.154788:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3311:1874416186261120:0@lo:400:kworker.0 00000100:00100000:2.0:1787582936.154854:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582936.154913:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787582936.154920:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186261248:0@lo:400:kworker.0 00000100:00100000:2.0:1787582936.154947:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582936.154980:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186261376:0@lo:8:kworker.0 00000100:00100000:2.0:1787582936.155002:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582936.155026:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186261504:0@lo:400:kworker.0 00000100:00100000:2.0:1787582936.155049:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582936.155065:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787582936.155070:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186261632:0@lo:400:kworker.0 00000100:00100000:2.0:1787582936.155092:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582936.155130:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186261248 00000100:00100000:2.0:1787582936.155136:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186261248 00000100:00100000:2.0:1787582936.155178:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186261376 00000100:00100000:2.0:1787582936.155194:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186261376 00000100:00100000:2.0:1787582936.155221:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787582936.155230:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186261248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582936.155275:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186261248:12345-0@lo:400:kworker.0 Request processed in 46us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582936.155282:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787582936.155297:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787582936.155302:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874416186261376:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787582936.155339:0:15014:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787582936.159342:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186261120 00000100:00100000:1.0:1787582936.159369:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186261120 00000100:00100000:1.0:1787582936.159426:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787582936.159436:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:3311:x1874416186261120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582936.159508:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:3311:x1874416186261120:12345-0@lo:400:kworker.0 Request processed in 74us (4653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582936.159515:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1787582936.160419:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787582936.160440:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186261504 00000100:00100000:0.0:1787582936.160446:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186261504 00000100:00100000:0.0:1787582936.160477:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186261632 00000100:00100000:0.0:1787582936.160480:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186261632 00000100:00100000:0.0:1787582936.160504:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787582936.160511:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186261504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582936.160564:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186261504:12345-0@lo:400:kworker.0 Request processed in 53us (5514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582936.160570:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787582936.160584:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787582936.160590:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186261632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582936.160619:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186261632:12345-0@lo:400:kworker.0 Request processed in 29us (5526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582936.160639:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787582936.160661:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582936.168507:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787582936.168534:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186261760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787582936.168601:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582936.168731:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186261760 00000100:00100000:3.0:1787582936.168739:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186261760 00000100:00100000:3.0:1787582936.168782:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787582936.168790:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186261760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787582936.168825:0:15016:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582936.168871:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186261760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582936.168878:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787582936.168924:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787582936.168946:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186261760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787582936.172421:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186261248:0@lo:400:kworker.0 00000100:00100000:0.0:1787582936.172437:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3311:1874416186261120:0@lo:400:kworker.0 00010000:00080000:0.0:1787582936.177454:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da482a98700 x1874416186261632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582936.177471:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186261632:0@lo:400:kworker.0 00010000:00080000:0.0:1787582936.177485:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da482a99c00 x1874416186261504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787582936.177493:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186261504:0@lo:400:kworker.0 00000100:00100000:2.0:1787582936.191722:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874416186261376:12345-0@lo:8:kworker.0 Request processed in 36411us (36711us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787582936.191736:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787582936.191857:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5a1547800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787582936.191873:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787582936.191878:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186261376:0@lo:8:kworker.0 00010000:00010000:2.0:1787582936.785259:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582937.824392:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787582938.258936:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787582938.832856:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787582939.532855:0:15733:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787582939.532880:0:15733:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787582939.533269:0:15733:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8da5bb7f1000 00000020:01000004:1.0:1787582939.533283:0:15733:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787582939.533295:0:15733:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787582939.533792:0:15733:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8da589c299b8) 00000020:00000080:1.0:1787582939.533811:0:15733:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787582939.572917:0:15733:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787582939.573673:0:15733:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787582939.580084:0:15733:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787582939.580364:0:15733:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787582939.580583:0:15733:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787582939.580979:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 407: rc = 0 00100000:10000000:3.0:1787582939.581073:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 407: rc = 0 00100000:10000000:3.0:1787582939.581167:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 407: rc = 0 00100000:10000000:3.0:1787582939.588820:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 428: rc = 0 00100000:10000000:3.0:1787582939.589102:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 428: rc = 0 00100000:10000000:3.0:1787582939.592394:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 428: rc = 0 00100000:10000000:3.0:1787582939.592734:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 428: rc = 0 00100000:10000000:3.0:1787582939.592969:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 428: rc = 0 00100000:10000000:3.0:1787582939.593206:0:15733:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 428: rc = 0 00000020:00000080:3.0:1787582939.593852:0:15733:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787582939.593865:0:15733:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787582939.593874:0:15733:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa113d808b7538ea4 00000020:01000004:3.0:1787582939.593881:0:15733:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787582939.593900:0:15733:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.120@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787582939.593903:0:15733:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.120@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787582939.593908:0:15733:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787582939.593927:0:15733:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787582939.593931:0:15733:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.120@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787582939.610557:0:15733:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.120@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787582939.610597:0:15733:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.120@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787582939.610601:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787582939.610603:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787582939.610605:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582939.610606:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582939.610607:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582939.610608:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582939.610610:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787582939.610611:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582939.610613:0:15733:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787582939.610616:0:15733:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787582939.610618:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787582939.610619:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787582939.610620:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582939.610621:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582939.610622:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582939.610623:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582939.610624:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787582939.610630:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582939.610631:0:15733:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787582939.610672:0:15733:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787582939.610690:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186261888:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787582939.610769:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582939.611352:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5892c6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787582939.611466:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186261888 00000100:00100000:0.0:1787582939.611473:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186261888 00000100:00100000:0.0:1787582939.611515:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787582939.611524:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:15733:x1874416186261888:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787582939.611552:0:14321:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787582939.611555:0:14321:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787582939.611559:0:14321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787582939.627872:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:15733:x1874416186261888:12345-0@lo:253:mount.lustre.0 Request processed in 16341us (17095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582939.627885:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787582939.627969:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186261888:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787582939.627985:0:15733:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787582939.627989:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787582939.627990:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787582939.627991:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787582939.627993:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787582939.627994:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787582939.627995:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787582939.627996:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787582939.627998:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787582939.627999:0:15733:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787582939.628021:0:15733:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8da5bb7f1000 from lustre-OST0001 10000000:01000000:2.0:1787582939.628047:0:15733:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787582939.628050:0:15733:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787582939.628058:0:15733:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8da5b50219b8 local copy 00010000:00010000:2.0:1787582939.628067:0:15733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ea00/0xa113d808b7538c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538c58 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582939.628546:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262016:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787582939.628587:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582939.628731:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da582a86e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787582939.628778:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186262016 00000100:00100000:3.0:1787582939.628785:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186262016 00000100:00100000:3.0:1787582939.628861:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787582939.628872:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:15733:x1874416186262016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787582939.629131:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:15733:x1874416186262016:12345-0@lo:501:mount.lustre.0 Request processed in 260us (542us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787582939.629138:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787582939.629453:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262016:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787582939.629468:0:15733:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.120@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787582939.629639:0:15733:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.120@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787582939.629646:0:15733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ea00/0xa113d808b7538c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538c58 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.629673:0:15733:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9ea00/0xa113d808b7538c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538c58 expref: -99 pid: 14311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582939.629697:0:15733:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8da5bb7f1000 10000000:01000000:2.0:1787582939.629702:0:15733:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787582939.629707:0:15733:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787582939.629710:0:15733:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787582939.629714:0:15733:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787582939.629717:0:15733:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787582939.629741:0:15733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fa00/0xa113d808b7538eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.629749:0:15733:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fa00/0xa113d808b7538eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.629757:0:15733:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fa00/0xa113d808b7538eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582939.629772:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787582939.629804:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582939.630813:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da582a86e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787582939.630906:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186262144 00000100:00100000:1.0:1787582939.630914:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186262144 00000100:00100000:0.0:1787582939.631061:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787582939.631071:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:15733:x1874416186262144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787582939.631083:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582939.631096:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5c20eee00/0xa113d808b7538eb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538eab expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582939.631118:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5c20eee00/0xa113d808b7538eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538eab expref: 17 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582939.631127:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5c20eee00/0xa113d808b7538eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538eab expref: 17 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582939.631135:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20eee00, rc 0) 00000100:00100000:0.0:1787582939.631231:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:15733:x1874416186262144:12345-0@lo:101:mount.lustre.0 Request processed in 161us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582939.631248:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787582939.631454:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787582939.631470:0:15733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fa00/0xa113d808b7538eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538eb2 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.631480:0:15733:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fa00/0xa113d808b7538eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538eb2 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787582939.632221:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787582939.635901:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787582939.636159:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787582939.636205:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787582939.636238:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787582939.636284:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787582939.636508:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787582939.636548:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787582939.636604:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787582939.636611:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787582939.636822:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787582939.636886:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582939.636927:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da582a86b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787582939.636995:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186262272 00000100:00100000:0.0:1787582939.637002:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186262272 00000100:00100000:0.0:1787582939.637050:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787582939.637060:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:15733:x1874416186262272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787582939.637500:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:15733:x1874416186262272:12345-0@lo:501:mount.lustre.0 Request processed in 440us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582939.637509:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787582939.638501:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787582939.638557:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787582939.638637:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582939.638678:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da582a86b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787582939.638801:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186262400 00000100:00100000:0.0:1787582939.638807:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186262400 00000100:00100000:0.0:1787582939.638852:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787582939.638860:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:15733:x1874416186262400:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787582939.639173:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:15733:x1874416186262400:12345-0@lo:503:mount.lustre.0 Request processed in 313us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582939.639180:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787582939.639894:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262400:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787582939.640982:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787582939.641056:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787582939.641125:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582939.641293:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da582a86b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787582939.643043:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186262528 00000100:00100000:3.0:1787582939.643056:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186262528 00000100:00100000:2.0:1787582939.644148:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787582939.644164:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:15733:x1874416186262528:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787582939.644682:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:15733:x1874416186262528:12345-0@lo:502:mount.lustre.0 Request processed in 521us (3554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582939.644697:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787582939.645243:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787582939.645532:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787582939.645592:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787582939.645780:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787582939.645836:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787582939.645875:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787582939.645913:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787582939.645996:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787582939.646046:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787582939.646099:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787582939.646136:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787582939.646194:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582939.646380:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186262656 00000100:00100000:3.0:1787582939.646387:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186262656 00000100:00100000:3.0:1787582939.646432:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787582939.646441:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:15733:x1874416186262656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787582939.646601:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:15733:x1874416186262656:12345-0@lo:502:mount.lustre.0 Request processed in 161us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582939.646608:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787582939.646798:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da589db30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582939.646817:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787582939.646885:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787582939.646895:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787582939.648708:0:15734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787582939.648716:0:15734:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787582939.648722:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787582939.648724:0:15734:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787582939.648730:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787582939.648743:0:15734:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8da588594d28) 00000020:00000080:0.0:1787582939.648763:0:15734:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787582939.648768:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787582939.648820:0:15734:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8da5bb7f1000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787582939.648826:0:15734:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787582939.648831:0:15734:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa113d808b7538ec0 00010000:00010000:0.0:1787582939.654294:0:15734:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1787582939.654846:0:15734:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1787582939.657099:0:15734:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787582939.658844:0:15734:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787582939.658855:0:15734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582939.658861:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582939.658863:0:15734:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787582939.658867:0:15734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582939.658871:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582939.658873:0:15734:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787582939.658876:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787582939.658878:0:15734:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787582939.658880:0:15734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582939.658882:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582939.658883:0:15734:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787582939.658886:0:15734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582939.658888:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582939.658890:0:15734:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787582939.658893:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787582939.658952:0:15734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582939.658956:0:15734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582939.658968:0:15734:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787582939.658972:0:15734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787582939.659122:0:15733:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787582939.659152:0:15733:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787582939.659171:0:15733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fa00/0xa113d808b7538eab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538eb2 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.659182:0:15733:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fa00/0xa113d808b7538eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538eb2 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582939.659191:0:15733:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da5bb7f1000 from 1 10000000:01000000:2.0:1787582939.659193:0:15733:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787582939.659225:0:15733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fe00/0xa113d808b7538ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.659232:0:15733:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fe00/0xa113d808b7538ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.659243:0:15733:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fe00/0xa113d808b7538ec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582939.659265:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787582939.659355:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582939.659394:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da582a86480 going to sleep for 11 seconds 00000100:00100000:0.0:1787582939.659467:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186262784 00000100:00100000:0.0:1787582939.659474:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186262784 00000100:00100000:0.0:1787582939.659513:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787582939.659522:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:15733:x1874416186262784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787582939.659533:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582939.659545:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5c20ee000/0xa113d808b7538ece lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538ec7 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582939.659570:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5c20ee000/0xa113d808b7538ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538ec7 expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582939.659581:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5c20ee000/0xa113d808b7538ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538ec7 expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582939.659590:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5c20ee000, rc 0) 00000100:00100000:0.0:1787582939.659643:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:15733:x1874416186262784:12345-0@lo:101:mount.lustre.0 Request processed in 122us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582939.659660:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787582939.659848:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787582939.659863:0:15733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fe00/0xa113d808b7538ec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538ece expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.659871:0:15733:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fe00/0xa113d808b7538ec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538ece expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787582939.660367:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787582939.661734:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787582939.662065:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787582939.662109:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787582939.662165:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787582939.662173:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787582939.662246:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787582939.662300:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582939.662356:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da582a86480 going to sleep for 11 seconds 00000100:00100000:3.0:1787582939.662529:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186262912 00000100:00100000:3.0:1787582939.662535:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186262912 00000100:00100000:3.0:1787582939.662581:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787582939.662590:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:15733:x1874416186262912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787582939.662866:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:15733:x1874416186262912:12345-0@lo:501:mount.lustre.0 Request processed in 276us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582939.662875:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787582939.664580:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186262912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787582939.664826:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263040:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787582939.664890:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582939.665711:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da582a86480 going to sleep for 11 seconds 00000100:00100000:0.0:1787582939.670160:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186263040 00000100:00100000:0.0:1787582939.670174:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186263040 00000100:00100000:0.0:1787582939.672196:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787582939.672218:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:15733:x1874416186263040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787582939.672551:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:15733:x1874416186263040:12345-0@lo:503:mount.lustre.0 Request processed in 342us (7660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582939.672559:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787582939.672714:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263040:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787582939.673394:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787582939.673472:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263168:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787582939.673526:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582939.677399:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf3d9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787582939.679150:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186263168 00000100:00100000:2.0:1787582939.679163:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186263168 00000100:00100000:2.0:1787582939.679210:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787582939.679221:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:15733:x1874416186263168:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787582939.679529:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:15733:x1874416186263168:12345-0@lo:502:mount.lustre.0 Request processed in 309us (6001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582939.679537:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787582939.679728:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263168:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787582939.679980:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787582939.680030:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787582939.680077:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787582939.680114:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787582939.680149:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787582939.680196:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787582939.680230:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787582939.680263:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787582939.680297:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263296:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787582939.680370:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582939.680388:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf3d9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787582939.680553:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186263296 00000100:00100000:2.0:1787582939.680560:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186263296 00000100:00100000:2.0:1787582939.680589:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787582939.680598:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf6e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:15733:x1874416186263296:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787582939.680779:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf6e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:15733:x1874416186263296:12345-0@lo:502:mount.lustre.0 Request processed in 181us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582939.680792:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787582939.680970:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263296:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787582939.681061:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787582939.681071:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787582939.685108:0:15738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582939.685121:0:15738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582939.685124:0:15738:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787582939.685131:0:15738:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8da5bb7f1000 00000020:00000080:3.0:1787582939.685133:0:15738:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787582939.685139:0:15738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582939.685141:0:15738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582939.685143:0:15738:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787582939.685145:0:15738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582939.685147:0:15738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582939.685149:0:15738:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787582939.685151:0:15738:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8da5bb7f1000 00000020:00000080:3.0:1787582939.685153:0:15738:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787582939.685212:0:15738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582939.685216:0:15738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582939.685217:0:15738:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787582939.685220:0:15738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787582939.685222:0:15738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582939.685223:0:15738:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787582939.685226:0:15738:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8da5bb7f1000 00000020:00000080:3.0:1787582939.685228:0:15738:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787582939.685262:0:15738:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787582939.685267:0:15738:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787582939.685268:0:15738:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787582939.685271:0:15738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787582939.687764:0:15733:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787582939.687803:0:15733:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787582939.687822:0:15733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fe00/0xa113d808b7538ec7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538ece expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582939.687835:0:15733:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fe00/0xa113d808b7538ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538ece expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582939.687885:0:15733:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787582939.687888:0:15733:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8da5bb7f1000 10000000:01000000:1.0:1787582939.687892:0:15733:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8da5bb7f1000 10000000:01000000:1.0:1787582939.687896:0:15733:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787582939.687901:0:15733:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8da5bb7f1000 from 1 10000000:01000000:1.0:1787582939.687904:0:15733:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787582939.687937:0:15733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da580030e00/0xa113d808b7538ed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582939.687945:0:15733:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da580030e00/0xa113d808b7538ed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582939.687955:0:15733:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da580030e00/0xa113d808b7538ed5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582939.687988:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263424:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787582939.688049:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582939.688087:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186263424 00000100:00100000:1.0:1787582939.688093:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186263424 00000100:00100000:1.0:1787582939.688130:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787582939.688138:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf6e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:15733:x1874416186263424:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787582939.688150:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582939.688161:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da580031a00/0xa113d808b7538edc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538ed5 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582939.688184:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da580031a00/0xa113d808b7538edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538ed5 expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582939.688193:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da580031a00/0xa113d808b7538edc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538ed5 expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582939.688201:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580031a00, rc 0) 00000100:00100000:1.0:1787582939.688230:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf6e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:15733:x1874416186263424:12345-0@lo:101:mount.lustre.0 Request processed in 93us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582939.688236:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787582939.688276:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58846d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787582939.688297:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787582939.688310:0:15733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da580030e00/0xa113d808b7538ed5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538edc expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582939.688337:0:15733:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da580030e00/0xa113d808b7538ed5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538edc expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787582939.688915:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787582939.689376:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787582939.689616:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787582939.689675:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787582939.689729:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787582939.689782:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787582939.689819:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787582939.689868:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787582939.689903:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787582939.689932:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787582939.689976:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787582939.690013:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787582939.690048:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787582939.690092:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787582939.690123:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787582939.690153:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787582939.690194:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787582939.690227:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787582939.690263:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787582939.690308:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787582939.690368:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787582939.690400:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787582939.690444:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787582939.690474:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787582939.690502:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787582939.690544:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787582939.699411:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787582939.699455:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787582939.699576:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787582939.699617:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787582939.699664:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787582939.699728:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787582939.699767:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787582939.699801:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787582939.699836:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787582939.699883:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787582939.699934:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787582939.699985:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787582939.700023:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787582939.700117:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787582939.700124:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787582939.700223:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787582939.700285:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582939.700354:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58846d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787582939.706077:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186263552 00000100:00100000:2.0:1787582939.706093:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186263552 00000100:00100000:2.0:1787582939.706153:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787582939.706164:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:15733:x1874416186263552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787582939.706483:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:15733:x1874416186263552:12345-0@lo:501:mount.lustre.0 Request processed in 320us (6197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582939.706491:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787582939.707039:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787582939.707085:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787582939.707132:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582939.707169:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58846d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787582939.707276:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186263680 00000100:00100000:2.0:1787582939.707282:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186263680 00000100:00100000:2.0:1787582939.707343:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787582939.707352:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:15733:x1874416186263680:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787582939.707639:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:15733:x1874416186263680:12345-0@lo:503:mount.lustre.0 Request processed in 288us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582939.707645:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787582939.707750:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263680:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787582939.708231:0:15733:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787582939.708290:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263808:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787582939.708362:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582939.708384:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58846d840 going to sleep for 11 seconds 00000100:00100000:2.0:1787582939.709026:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186263808 00000100:00100000:2.0:1787582939.709034:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186263808 00000100:00100000:2.0:1787582939.709078:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787582939.709087:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:15733:x1874416186263808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787582939.709408:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:15733:x1874416186263808:12345-0@lo:502:mount.lustre.0 Request processed in 321us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582939.709416:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787582939.711694:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263808:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787582939.712004:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787582939.712068:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787582939.712102:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787582939.712148:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787582939.712196:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787582939.712253:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787582939.712289:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787582939.712348:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787582939.712394:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787582939.712425:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787582939.712454:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787582939.712494:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787582939.712525:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787582939.712553:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787582939.712608:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787582939.712648:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787582939.712692:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787582939.712753:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787582939.712789:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787582939.712823:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787582939.712871:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787582939.712909:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787582939.712940:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787582939.712983:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787582939.713016:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787582939.713047:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787582939.713089:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787582939.713123:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787582939.713160:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787582939.713209:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787582939.713246:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787582939.713279:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787582939.713312:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787582939.713402:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787582939.713438:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787582939.713494:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787582939.713528:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787582939.713566:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787582939.713608:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787582939.713642:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787582939.713692:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263936:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787582939.713759:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582939.713806:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186263936 00000100:00100000:1.0:1787582939.713812:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186263936 00000100:00100000:1.0:1787582939.713858:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787582939.713867:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:15733:x1874416186263936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787582939.714055:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:15733:x1874416186263936:12345-0@lo:502:mount.lustre.0 Request processed in 189us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582939.714063:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787582939.714114:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58846d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787582939.714134:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186263936:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787582939.714194:0:15733:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787582939.714203:0:15733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787582939.731677:0:15743:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787582939.731694:0:15743:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8da5bf2d8000) 00000020:00000080:3.0:1787582939.731716:0:15743:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787582939.731813:0:15743:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8da5bb7f1000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787582939.731817:0:15743:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8da5bb7f1000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787582939.731824:0:15743:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8da5bb7f1000 3 00010000:00080000:3.0:1787582939.731853:0:15743:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8da5b608b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.120@tcp at head 00010000:00010000:3.0:1787582939.739196:0:15743:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1787582939.739484:0:15743:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787582939.739521:0:15743:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787582939.739534:0:15743:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa113d808b7538eea 00000100:00080000:3.0:1787582939.739543:0:15743:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787582939.739549:0:15743:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8da5b608b800 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:3.0:1787582939.739583:0:15743:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5ad9ad880 x1874416186264064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787582939.739607:0:15743:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787582939.739784:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874416186264064:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787582939.739848:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582939.739906:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186264064 00000100:00100000:2.0:1787582939.739920:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186264064 00000100:00100000:2.0:1787582939.739950:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787582939.739957:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874416186264064:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787582939.739975:0:14331:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:2.0:1787582939.740004:0:14331:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa113d808b7538ef1 00000004:00100000:2.0:1787582939.740017:0:14331:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787582939.740041:0:14331:0:(import.c:65:import_set_state_nolock()) ffff8da482fc2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787582939.740086:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874416186264064:12345-0@lo:38:llog_process_th.0 Request processed in 128us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582939.740092:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787582939.740128:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da5ad9ad880 x1874416186264064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787582949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582939.740137:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787582939.740143:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787582939.740148:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787582939.740151:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787582939.740153:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5b608b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787582939.740158:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874416186264064:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787582939.740944:0:12709:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787582939.740949:0:12709:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787582939.740952:0:12709:0:(import.c:65:import_set_state_nolock()) ffff8da5a1547800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787582939.740956:0:12709:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:1.0:1787582939.740960:0:12709:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1787582939.740963:0:12709:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8da5a1547800 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:1.0:1787582939.740979:0:12709:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da482a98380 x1874416186264320/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:3.0:1787582939.741221:0:15743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:3.0:1787582939.741375:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787582939.741386:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186264192:0@lo:400:kworker.0 00000100:00100000:3.0:1787582939.741428:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582939.741911:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186264192 00000100:00100000:3.0:1787582939.741919:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186264192 00000100:00100000:3.0:1787582939.741966:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787582939.741975:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186264192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582939.742021:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186264192:12345-0@lo:400:kworker.0 Request processed in 47us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582939.742027:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000000:1.0:1787582939.742131:0:15733:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787582939.742156:0:15733:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787582939.742178:0:15733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da580030e00/0xa113d808b7538ed5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538edc expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582939.742188:0:15733:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da580030e00/0xa113d808b7538ed5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538edc expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787582939.742229:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787582939.742231:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787582939.742233:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787582939.742234:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787582939.742235:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787582939.742236:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787582939.742238:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787582939.742240:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787582939.742241:0:15733:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787582939.742244:0:15733:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787582939.742247:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787582939.742248:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787582939.742249:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787582939.742250:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787582939.742251:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787582939.742252:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787582939.742253:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787582939.742254:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787582939.742256:0:15733:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787582939.742273:0:15733:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787582939.742285:0:15733:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186264704:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787582939.742337:0:15733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582939.742359:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186264704 00000100:00100000:1.0:1787582939.742363:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186264704 00000100:00100000:1.0:1787582939.742386:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787582939.742392:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:15733:x1874416186264704:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787582939.742421:0:14324:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787582939.742434:0:14324:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787582939.742828:0:15733:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58846da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787582939.743006:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874416186264576:0@lo:400:kworker.0 00000100:00100000:2.0:1787582939.743039:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582939.743069:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787582939.743075:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186264448:0@lo:400:kworker.0 00000100:00100000:2.0:1787582939.743096:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582939.743138:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186264320:0@lo:8:kworker.0 00000100:00100000:2.0:1787582939.743159:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582939.743188:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186264320 00000100:00100000:2.0:1787582939.743192:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186264320 00000100:00100000:2.0:1787582939.743209:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787582939.743214:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874416186264320:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787582939.743253:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874416186264320:12345-0@lo:8:kworker.0 Request processed in 37us (93us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787582939.743259:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787582939.743274:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186264576 00000100:00100000:2.0:1787582939.743276:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186264576 00000100:00100000:2.0:1787582939.743299:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186264448 00000100:00100000:2.0:1787582939.743301:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186264448 00000100:00100000:2.0:1787582939.743312:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787582939.743338:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874416186264576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582939.743369:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874416186264576:12345-0@lo:400:kworker.0 Request processed in 52us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582939.743375:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787582939.743385:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787582939.743390:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186264448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582939.743410:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186264448:12345-0@lo:400:kworker.0 Request processed in 20us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582939.743416:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1787582939.743443:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da482a98000 x1874416186264448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582939.743456:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186264448:0@lo:400:kworker.0 00010000:00080000:2.0:1787582939.743465:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8da482a9b480 x1874416186264576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582939.743473:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874416186264576:0@lo:400:kworker.0 00000100:00100000:2.0:1787582939.743504:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787582939.743510:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5a1547800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787582939.743513:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787582939.743517:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186264320:0@lo:8:kworker.0 00000100:00080000:2.0:1787582939.743632:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787582939.743637:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787582939.743671:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186264192:0@lo:400:kworker.0 20000000:01000000:1.0:1787582939.779053:0:14324:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787582939.779072:0:14324:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787582939.779340:0:14345:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787582939.779344:0:14345:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787582939.779363:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8da5a08d0400/0xa113d808b7538ef8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582939.779381:0:14345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5a08d0000/0xa113d808b7538dd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538dcb expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582939.779404:0:14345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8da5a08d0400/0xa113d808b7538ef8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582939.779436:0:14345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5a08d0000/0xa113d808b7538dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7538dcb expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582939.779450:0:14345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da5a08d0000/0xa113d808b7538dd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7538dcb expref: 19 pid: 14323 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582939.779465:0:14345:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ac000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14345:1874416186264832:0@lo:104: 00000100:00100000:3.0:1787582939.779521:0:14345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582939.779556:0:14345:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5bf3d9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582939.779750:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186264832 00000100:00100000:1.0:1787582939.779757:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186264832 00000100:00100000:1.0:1787582939.779797:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787582939.779805:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+3:14345:x1874416186264832:12345-0@lo:104: 00010000:00010000:1.0:1787582939.779817:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538dcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7538dd2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582939.779864:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787582939.779870:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+3:14345:x1874416186264832:12345-0@lo:104: Request processed in 67us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582939.779877:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787582939.779924:0:14345:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ac000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14345:1874416186264832:0@lo:104: 00010000:00010000:1.0:1787582939.779943:0:14345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8da5a08d0400/0xa113d808b7538ef8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780109:0:15403:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582939.780116:0:15403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538dcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7538dd2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780124:0:15403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0800 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:2.0:1787582939.780128:0:15403:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538dcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7538dd2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780137:0:15403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7538dd2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787582939.780143:0:15403:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7538dd2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787582939.780149:0:15403:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787582939.780178:0:15403:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538dcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538dd2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780185:0:15403:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787582939.780200:0:15403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538dcb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538dd2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780217:0:15403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5a08d0800/0xa113d808b7538dcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538dd2 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780231:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582939.780233:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582939.780234:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582939.780247:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3311:1874416186264960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787582939.780278:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582939.780308:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186264960 00000100:00100000:2.0:1787582939.780313:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186264960 00010000:00010000:2.0:1787582939.780353:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5a08d0000/0xa113d808b7538dd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7538dcb expref: 20 pid: 14323 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582939.780372:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787582939.780378:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+20:3311:x1874416186264960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787582939.780387:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582939.780391:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5a08d0000/0xa113d808b7538dd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7538dcb expref: 20 pid: 14323 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780400:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5a08d0000/0xa113d808b7538dd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7538dcb expref: 20 pid: 14323 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780411:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5a08d0000/0xa113d808b7538dd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7538dcb expref: 20 pid: 14323 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780422:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8da5a08d0400/0xa113d808b7538ef8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780439:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5a08d0400/0xa113d808b7538ef8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787582939.780450:0:14315:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003932759s 00010000:00010000:2.0:1787582939.780454:0:14315:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5a08d0400/0xa113d808b7538ef8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780460:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da5a08d0400/0xa113d808b7538ef8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780466:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8da5a08d0400/0xa113d808b7538ef8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780471:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8da5a08d0400/0xa113d808b7538ef8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780475:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d0400 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582939.780478:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8da5a08d0400/0xa113d808b7538ef8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780484:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8da5a08d0400/0xa113d808b7538ef8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780497:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8da5a08d0400/0xa113d808b7538ef8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780505:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582939.780530:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:3311:x1874416186264960:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582939.780536:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787582939.780571:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3311:1874416186264960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787582939.780585:0:14345:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8da5a08d0400/0xa113d808b7538ef8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780592:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8da5a08d0400/0xa113d808b7538ef8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582939.780598:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5a08d0400/0xa113d808b7538ef8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582939.790934:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:15733:x1874416186264704:12345-0@lo:253:mount.lustre.0 Request processed in 48533us (48587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582939.790948:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787582939.791050:0:15733:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:3e2cf41e-7ffc-455b-9803-c6c5675ba817:15733:1874416186264704:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787582939.791067:0:15733:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787582939.791071:0:15733:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787582939.791072:0:15733:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787582939.791074:0:15733:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787582939.791075:0:15733:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787582939.791076:0:15733:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787582939.791077:0:15733:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787582939.791079:0:15733:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787582939.791081:0:15733:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787582939.791082:0:15733:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787582939.791095:0:15733:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787582939.795983:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787582939.796167:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787582939.796472:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787582939.797290:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787582939.797518:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787582939.797992:0:15733:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787582939.799082:0:15733:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787582939.843264:0:15733:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787582939.843271:0:15733:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787582939.843304:0:15733:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787582939.843389:0:15733:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.120@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787582939.843402:0:15733:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787582939.843426:0:15733:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787582939.858039:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582940.880583:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582941.264920:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186265088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787582941.265020:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582941.265159:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186265088 00000100:00100000:1.0:1787582941.265168:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186265088 00000100:00100000:1.0:1787582941.265237:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787582941.265248:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186265088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787582941.265292:0:15016:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787582941.266426:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787582941.268213:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186265088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2956us (3183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582941.268231:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787582941.270017:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186265088:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1787582941.523178:0:14326:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787582941.523190:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8da5ad665000 from 8 10000000:01000000:2.0:1787582941.523196:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787582941.523259:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582941.523273:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582941.523286:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538eff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582941.523345:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186265216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787582941.523731:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582941.523854:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58318e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582941.526598:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186265216 00000100:00100000:1.0:1787582941.526627:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186265216 00000100:00100000:1.0:1787582941.526718:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787582941.526731:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:14326:x1874416186265216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582941.526754:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582941.526780:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da580031e00/0xa113d808b7538f06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7538eff expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582941.526817:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da580031e00/0xa113d808b7538f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7538eff expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582941.526842:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da580031e00/0xa113d808b7538f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538eff expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582941.526852:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580031e00, rc 0) 00000100:00100000:1.0:1787582941.526953:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:14326:x1874416186265216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (3223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582941.526960:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787582941.529470:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186265216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582941.529511:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538eff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538f06 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582941.529527:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538eff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7538f06 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582941.529637:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186265344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787582941.529742:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582941.529789:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787582941.529927:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186265344 00000100:00100000:1.0:1787582941.529936:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186265344 00000100:00100000:1.0:1787582941.529999:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787582941.530010:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:14326:x1874416186265344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787582941.530035:0:14324:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787582941.530057:0:14324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787582941.530061:0:14324:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787582941.530168:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:14326:x1874416186265344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 159us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582941.530177:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787582941.530424:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186265344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787582941.530506:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787582941.530515:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538eff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538f06 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582941.530524:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9f000/0xa113d808b7538eff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7538f06 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582941.904523:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582942.928466:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582943.955087:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787582944.849728:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787582944.849736:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787582944.849749:0:38:0:(import.c:65:import_set_state_nolock()) ffff8da5a1547800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787582944.849764:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8da5a1547800 using connection 192.168.206.120@tcp/0@lo 00000100:00100000:2.0:1787582944.849794:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8da5adbf5f80 x1874416186265728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787582944.849947:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186265600:0@lo:400:kworker.0 00000100:00100000:2.0:1787582944.850041:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582944.850121:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787582944.850127:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3314:1874416186265472:0@lo:400:kworker.0 00000100:00100000:2.0:1787582944.850160:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582944.850193:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874416186266112:0@lo:400:kworker.0 00000100:00100000:2.0:1787582944.850220:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582944.850261:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186265728:0@lo:8:kworker.0 00000100:00100000:2.0:1787582944.850285:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582944.850313:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186265856:0@lo:400:kworker.0 00000100:00100000:2.0:1787582944.850359:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582944.850375:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787582944.850380:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5adbf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186265984:0@lo:400:kworker.0 00000100:00100000:2.0:1787582944.850399:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582944.850427:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186265600 00000100:00100000:2.0:1787582944.850436:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186265600 00000100:00100000:2.0:1787582944.850493:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186265728 00000100:00100000:2.0:1787582944.850496:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186265728 00000100:00100000:2.0:1787582944.850512:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787582944.850522:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186265600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582944.850580:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186265600:12345-0@lo:400:kworker.0 Request processed in 59us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582944.850599:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787582944.850619:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787582944.850636:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874416186265728:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787582944.850666:0:15014:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 485 last 0 00000020:00000080:2.0:1787582944.850706:0:15014:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa113d808b7538f0d 00002000:00100000:2.0:1787582944.850729:0:15014:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8da482fc3800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787582944.850734:0:15014:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787582944.850737:0:15014:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787582944.851253:0:15014:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1787582944.851254:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186265472 00000100:00100000:1.0:1787582944.851262:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186265472 00000100:00080000:2.0:1787582944.851282:0:15014:0:(import.c:65:import_set_state_nolock()) ffff8da482fc0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582944.851301:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787582944.851311:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:3314:x1874416186265472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582944.851371:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874416186265728:12345-0@lo:8:kworker.0 Request processed in 733us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582944.851380:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787582944.851385:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:3314:x1874416186265472:12345-0@lo:400:kworker.0 Request processed in 73us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582944.851395:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787582944.851412:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186266112 00000100:00100000:2.0:1787582944.851418:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186266112 00000100:00100000:2.0:1787582944.851450:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186265984 00000100:00100000:2.0:1787582944.851453:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186265984 00000100:00100000:2.0:1787582944.851474:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787582944.851481:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874416186266112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582944.851523:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874416186266112:12345-0@lo:400:kworker.0 Request processed in 43us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582944.851530:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787582944.851542:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787582944.851549:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186265984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787582944.851582:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186265984:12345-0@lo:400:kworker.0 Request processed in 34us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582944.851595:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1787582944.851634:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787582944.851639:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787582944.851675:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adbf5f80 x1874416186265728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787582969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787582944.851695:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787582944.851704:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787582944.851710:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787582944.851712:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8da5a1547800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787582944.851730:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787582944.851736:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874416186265728:0@lo:8:kworker.0 00010000:00080000:2.0:1787582944.851774:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adbf4380 x1874416186265984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582944.851785:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186265984:0@lo:400:kworker.0 00000100:00100000:2.0:1787582944.851840:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3314:1874416186265472:0@lo:400:kworker.0 00000004:00080000:3.0:1787582944.851841:0:14354:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787582944.851877:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14354:1874416186266368:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787582944.851911:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582944.851935:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c6c0 going to sleep for 11 seconds 00010000:00080000:2.0:1787582944.852066:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adbf6300 x1874416186266112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787582944.852077:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874416186266112:0@lo:400:kworker.0 00000100:00100000:2.0:1787582944.852092:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186265600:0@lo:400:kworker.0 00000100:00100000:2.0:1787582944.852111:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186266240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582944.852144:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582944.852346:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186266240 00000100:00100000:3.0:1787582944.852352:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186266240 00000100:00100000:3.0:1787582944.852393:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787582944.852402:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874416186266240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787582944.852430:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582944.852487:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874416186266240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582944.852494:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787582944.852516:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787582944.852596:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186266368 00000100:00100000:0.0:1787582944.852602:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186266368 00000100:00100000:0.0:1787582944.852656:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787582944.852666:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14354:x1874416186266368:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787582944.854143:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186265856 00000100:00100000:1.0:1787582944.854158:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186265856 00000100:00100000:1.0:1787582944.854236:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787582944.854247:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186265856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582944.854354:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186265856:12345-0@lo:400:kworker.0 Request processed in 109us (3993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582944.854361:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:1.0:1787582944.854401:0:14353:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00002000:00080000:0.0:1787582944.856007:0:15013:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787582944.856022:0:15013:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787582944.856029:0:15013:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00010000:00080000:1.0:1787582944.856800:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5adbf5180 x1874416186265856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787582960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787582944.856826:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5adbf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186265856:0@lo:400:kworker.0 00000004:00080000:1.0:1787582944.859803:0:14353:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 485866481329ns, next at 0ns, rc = 0 00010000:00080000:3.0:1787582944.864171:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8da5ad9ae680 x1874416186266240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787582960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787582944.864213:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186266240:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1787582944.864308:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.864376:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.864396:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.864400:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.864407:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.864432:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.864442:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.864451:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.864495:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787582944.865366:0:15403:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582944.865380:0:15403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582944.865394:0:15403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e200 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:1.0:1787582944.865399:0:15403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582944.865411:0:15403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582944.865439:0:15403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582944.866664:0:15403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582944.867213:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582944.867218:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582944.867221:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.868574:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.868586:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.868619:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.868634:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.868641:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.868654:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.868664:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.868672:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.868693:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582944.868705:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.868710:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.868718:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147fa00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.868723:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.868744:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.868760:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.868770:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.872435:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.872448:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.872451:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.874772:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.874786:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.874803:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.874809:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.874816:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.874830:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.874841:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.874858:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.874881:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582944.874896:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.874902:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.874910:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147ec00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.874916:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.874927:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.874948:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.874957:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.874986:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.874991:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.874995:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.875722:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.875738:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.875750:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.875755:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.875760:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.875771:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.875780:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.875788:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.875809:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582944.875821:0:15403:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.875827:0:15403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.875835:0:15403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e600 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.875840:0:15403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.875849:0:15403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.875871:0:15403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f29 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.875880:0:15403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.875907:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.875911:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.875920:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.876494:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.876502:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.876513:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.876517:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.876523:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.876535:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.876544:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.876551:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.876591:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787582944.876829:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787582944.876846:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582944.876862:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147fc00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:1.0:1787582944.876868:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582944.876879:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582944.877054:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582944.877065:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582944.877104:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582944.877107:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787582944.877110:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.883806:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.883819:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.883836:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.883841:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.883847:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.883861:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.883873:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.883882:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.883911:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787582944.884355:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.884361:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.884370:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.884381:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.884386:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.884396:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.884404:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.884411:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.884425:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787582944.884439:0:15403:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787582944.884445:0:15403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.884453:0:15403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147fa00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.884458:0:15403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.884467:0:15403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.884483:0:15403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.884501:0:15403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.884519:0:15403:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.884523:0:15403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.884529:0:15403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147f000 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.884532:0:15403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.884540:0:15403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.884550:0:15403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.884558:0:15403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.884567:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.884569:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.884570:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582944.884960:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.885028:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.885036:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.885052:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.885056:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.885061:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.885072:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.885080:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.885087:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.888049:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582944.888080:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.888090:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.888350:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e200 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.888355:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.888367:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.888417:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f45 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.888426:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.888460:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.888466:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.888470:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.890804:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.890817:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.890834:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.890838:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.890845:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.890859:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.890870:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.890879:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.890914:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582944.890927:0:15403:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.890935:0:15403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.890943:0:15403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e400 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.890949:0:15403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.890959:0:15403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.890981:0:15403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f4c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.890990:0:15403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.891011:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.891013:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.891015:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.891558:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.891565:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.891575:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.891583:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.891588:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.891599:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.891608:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.891617:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.891647:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582944.891657:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.891662:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.891670:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e800 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.891674:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.891682:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.891698:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.891717:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.891732:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.891734:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.891736:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.894644:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.894663:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.894682:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.894687:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.894693:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.894707:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.894718:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.894727:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.894754:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582944.894772:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.894786:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.894794:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e200 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.894798:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.894808:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.894827:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.894835:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.894855:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.894857:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.894858:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.897009:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.897023:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.897039:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.897044:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.897051:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.897085:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.897095:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.897102:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.897124:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582944.897143:0:15403:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.897148:0:15403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.897156:0:15403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147f000 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.897160:0:15403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.897169:0:15403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.897185:0:15403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.897193:0:15403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538f61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.897226:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.897229:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.897232:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.898901:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.898911:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.898926:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.898931:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.898938:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.898955:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.898965:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.898973:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.899003:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787582944.899041:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582944.899055:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.899078:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147fa00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582944.899084:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.899096:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.899129:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f68 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.899138:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538f68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.899172:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582944.899175:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582944.899177:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.899533:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.899542:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.899565:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.899569:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.899573:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.899584:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.899593:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.899600:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.899633:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787582944.899657:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582944.899666:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.899675:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e600 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582944.899678:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.899687:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.899715:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.899723:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538f6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.899743:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582944.899748:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582944.899752:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.903513:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.903526:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.903543:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.903548:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.903556:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.903571:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.903593:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.903602:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.903645:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582944.903665:0:15403:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.903670:0:15403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.903678:0:15403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147ec00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.903684:0:15403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.903694:0:15403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.903715:0:15403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f76 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.903723:0:15403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.903744:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.903756:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.903758:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.904496:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.904504:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.904516:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.904520:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.904525:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.906062:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.906081:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.906088:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.906114:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787582944.906462:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582944.906593:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.906611:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147fc00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582944.906617:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.906643:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.906671:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f7d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.906680:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538f7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.906739:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582944.906742:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582944.906748:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.908385:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.908398:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.908414:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.908418:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.908424:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.908450:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.908461:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.908469:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.908493:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787582944.909114:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.909121:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.909133:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.909137:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.909142:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.909156:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.909165:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.909185:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.909210:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787582944.909229:0:15403:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787582944.909235:0:15403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.909244:0:15403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e200 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.909251:0:15403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.909260:0:15403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.909279:0:15403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f84 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.909287:0:15403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538f84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.909313:0:15403:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.909378:0:15403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.909397:0:15403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e800 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.909400:0:15403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.909408:0:15403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.909419:0:15403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f8b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.909426:0:15403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538f8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.909448:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.909450:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.909452:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582944.909911:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.910022:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.910031:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.910041:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.910045:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.910051:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.910064:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.910080:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.910088:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.910106:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787582944.910309:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582944.910345:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.910359:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e400 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582944.910363:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.910376:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.910402:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f92 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.910410:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e95221ff/0xa113d808b7538f92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.910430:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582944.910432:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582944.910434:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.910640:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.910649:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.910661:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.910664:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.910669:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.910682:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.910691:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.910699:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.910730:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582944.910742:0:15403:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.910748:0:15403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.910758:0:15403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147ec00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.910763:0:15403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.910773:0:15403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.910794:0:15403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f99 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.910803:0:15403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538f99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.910823:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.910825:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.910827:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.914744:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.914758:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538fa0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.914775:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.914787:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.914793:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538fa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.914809:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538fa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.914819:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538fa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.914828:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538fa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.914853:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582944.914867:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.914874:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538fa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.914882:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e800 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.914887:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538fa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.914897:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538fa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.914915:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538fa0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.914934:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7a2bb6b/0xa113d808b7538fa0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.914961:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.914963:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.914971:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.915669:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.915678:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538fa7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.915689:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.915694:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.915700:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538fa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.915712:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538fa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.915723:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538fa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.915731:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538fa7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.915755:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787582944.915794:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787582944.915808:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538fa7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582944.915831:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e200 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:2.0:1787582944.915837:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538fa7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582944.915849:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538fa7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582944.915877:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538fa7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582944.915885:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e97eee44/0xa113d808b7538fa7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582944.915925:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582944.915937:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582944.915942:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.916268:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.916283:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538fae lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.916292:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.916296:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.916301:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538fae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.916313:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538fae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.916367:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538fae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.916375:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538fae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.916392:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582944.916405:0:15403:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.916411:0:15403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538fae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.916418:0:15403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147f000 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.916422:0:15403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538fae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.916432:0:15403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538fae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.916456:0:15403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538fae lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.916465:0:15403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046d622ff/0xa113d808b7538fae lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.916486:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.916489:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.916491:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787582944.919604:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:0.0:1787582944.919878:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1787582944.919941:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.919951:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538fb5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.919968:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.919973:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.919979:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.919994:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.920006:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.920013:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538fb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.920045:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582944.920063:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.920069:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538fb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.920078:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147fc00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.920083:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538fb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.920092:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538fb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.920107:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538fb5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.920116:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bf2dd2a/0xa113d808b7538fb5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.920152:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.920154:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.920158:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.922937:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.922951:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538fbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.922966:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.922980:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.922987:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.923001:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.923011:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.923018:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538fbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.923047:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787582944.923093:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582944.923108:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538fbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.923200:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147ec00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582944.923207:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538fbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.923220:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538fbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.923246:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538fbc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.923254:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012302236/0xa113d808b7538fbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.923292:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582944.923295:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582944.923297:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.923577:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.923586:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538fc3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.923597:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.923601:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.923606:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.923616:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.923639:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.923655:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.923675:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582944.923691:0:15403:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.923698:0:15403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.923706:0:15403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e600 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.923711:0:15403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.923721:0:15403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.923737:0:15403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538fc3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.923746:0:15403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd93c3f2/0xa113d808b7538fc3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.923769:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.923772:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.923774:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.924226:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.924238:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.924248:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.924252:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.924256:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.924265:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.924293:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.924306:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.924358:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787582944.924371:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582944.924378:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.926708:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147fa00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582944.926717:0:14318:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.926732:0:14318:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.926768:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.926776:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.926800:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.926802:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582944.926804:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787582944.932576:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787582944.932593:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fd1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.932613:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=485s v=(0 0) 00010000:00010000:0.0:1787582944.932618:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582944.932638:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.932654:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.932666:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.932674:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582944.932709:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787582944.933140:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582944.933153:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.933165:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147fa00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582944.933171:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.933183:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.933216:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fd1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.933224:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002633f24/0xa113d808b7538fd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582944.933247:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582944.933250:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582944.933252:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787582944.933383:0:15013:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1787582944.933518:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14354:x1874416186266368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 80848us (81600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582944.933530:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787582944.933592:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad9af800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14354:1874416186266368:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787582944.933617:0:14354:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787582944.933696:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14354:1874416186266496:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787582944.933742:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582944.933801:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da584de2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582944.934343:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186266496 00000100:00100000:0.0:1787582944.934353:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186266496 00000100:00100000:0.0:1787582944.934405:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787582944.934415:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14354:x1874416186266496:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787582944.934461:0:15012:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1787582944.942458:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14354:x1874416186266496:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8035us (8707us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787582944.942474:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787582944.942553:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14354:1874416186266496:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787582944.942573:0:14354:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1787582944.980388:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582946.004224:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582946.392365:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186266624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582946.392462:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582946.392632:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186266624 00000100:00100000:2.0:1787582946.392642:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186266624 00000100:00080000:1.0:1787582946.393041:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787582946.393137:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787582946.393152:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186266624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582946.393203:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582946.393275:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186266624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582946.393283:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787582946.393452:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb681500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186266624:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787582946.948224:0:16092:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg620-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787582947.034733:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582948.056330:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787582948.497922:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787582949.020383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582949.020465:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162153344 00000100:00100000:3.0:1787582949.020474:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162153344 00000100:00100000:3.0:1787582949.020509:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 74 00000100:00100000:3.0:1787582949.020517:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2356:x1874416162153344:12345-192.168.206.20@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787582949.020542:0:14323:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 58cba94b-e776-4554-b8c0-88b86365e35e@192.168.206.20@tcp t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:3.0:1787582949.020568:0:14323:0:(genops.c:1385:class_connect()) connect: client 58cba94b-e776-4554-b8c0-88b86365e35e, cookie 0xa113d808b7538fd8 00000100:00080000:3.0:1787582949.020725:0:14323:0:(import.c:65:import_set_state_nolock()) ffff8da5b53c4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787582949.020811:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+5:2356:x1874416162153344:12345-192.168.206.20@tcp:250:mount.lustre.0 Request processed in 293us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582949.020820:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 74 00000100:00100000:3.0:1787582949.023914:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582949.024067:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162153472 00000100:00100000:1.0:1787582949.024076:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162153472 00000100:00100000:1.0:1787582949.024130:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 75 00000100:00100000:1.0:1787582949.024140:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+5:13743:x1874416162153472:12345-192.168.206.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787582949.024155:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582949.024172:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da580030a00/0xa113d808b7538fdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58375 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582949.024197:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da580030a00/0xa113d808b7538fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58375 expref: 6 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582949.024208:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da580030a00/0xa113d808b7538fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58375 expref: 6 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582949.024218:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580030a00, rc 0) 00000100:00100000:1.0:1787582949.024275:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+6:13743:x1874416162153472:12345-192.168.206.20@tcp:101:mount.lustre.0 Request processed in 135us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582949.024282:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 75 00000100:00100000:2.0:1787582949.027074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582949.027172:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162153600 00000100:00100000:1.0:1787582949.027180:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162153600 00000100:00100000:1.0:1787582949.027237:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 76 00000100:00100000:1.0:1787582949.027247:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+6:13743:x1874416162153600:12345-192.168.206.20@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787582949.027566:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+6:13743:x1874416162153600:12345-192.168.206.20@tcp:501:mount.lustre.0 Request processed in 319us (499us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787582949.027574:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 76 00000100:00100000:0.0:1787582949.029497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582949.029575:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162153728 00000100:00100000:3.0:1787582949.029583:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162153728 00000100:00100000:3.0:1787582949.029643:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 77 00000100:00100000:3.0:1787582949.029664:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+6:13743:x1874416162153728:12345-192.168.206.20@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787582949.029680:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582949.029696:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5a08d1400/0xa113d808b7538fe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5837c expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582949.029722:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5a08d1400/0xa113d808b7538fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5837c expref: 7 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582949.029732:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5a08d1400/0xa113d808b7538fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5837c expref: 7 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582949.029880:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1400, rc 0) 00000100:00100000:3.0:1787582949.029980:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+7:13743:x1874416162153728:12345-192.168.206.20@tcp:101:mount.lustre.0 Request processed in 317us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582949.029987:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 77 00000100:00100000:3.0:1787582949.036453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582949.036555:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162153856 00000100:00100000:2.0:1787582949.036565:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162153856 00000100:00100000:2.0:1787582949.036628:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 78 00000100:00100000:2.0:1787582949.036639:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+7:13743:x1874416162153856:12345-192.168.206.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787582949.037141:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+8:13743:x1874416162153856:12345-192.168.206.20@tcp:501:mount.lustre.0 Request processed in 502us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582949.037149:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 78 00000100:00100000:2.0:1787582949.046549:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582949.046646:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162153984 00000100:00100000:1.0:1787582949.046656:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162153984 00000100:00100000:1.0:1787582949.046703:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 79 00000100:00100000:1.0:1787582949.046711:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+8:13743:x1874416162153984:12345-192.168.206.20@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787582949.046964:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b25e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+8:13743:x1874416162153984:12345-192.168.206.20@tcp:503:mount.lustre.0 Request processed in 252us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582949.046972:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 79 00000100:00100000:0.0:1787582949.051121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582949.051429:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162154112 00000100:00100000:2.0:1787582949.051439:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162154112 00000100:00100000:2.0:1787582949.051497:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 80 00000100:00100000:2.0:1787582949.051505:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+8:13762:x1874416162154112:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787582949.051777:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+8:13762:x1874416162154112:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 272us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582949.051786:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 80 00000100:00100000:0.0:1787582949.066150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582949.066235:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162154240 00000100:00100000:3.0:1787582949.066245:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162154240 00000100:00100000:3.0:1787582949.066300:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 81 00000100:00100000:3.0:1787582949.066310:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+8:13762:x1874416162154240:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787582949.066592:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+8:13762:x1874416162154240:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 282us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582949.066611:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 81 00000100:00100000:3.0:1787582949.070175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582949.070432:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162154368 00000100:00100000:1.0:1787582949.070442:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162154368 00000100:00100000:1.0:1787582949.070504:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 82 00000100:00100000:1.0:1787582949.070513:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+8:13743:x1874416162154368:12345-192.168.206.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787582949.070530:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582949.070546:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da580031800/0xa113d808b7538fed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d583a6 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582949.070582:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da580031800/0xa113d808b7538fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583a6 expref: 9 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582949.070594:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da580031800/0xa113d808b7538fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583a6 expref: 9 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582949.070630:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580031800, rc 0) 00000100:00100000:1.0:1787582949.070692:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+9:13743:x1874416162154368:12345-192.168.206.20@tcp:101:mount.lustre.0 Request processed in 179us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582949.070700:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 82 00010000:00010000:3.0:1787582949.072983:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582949.078002:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582949.078213:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162154496 00000100:00100000:2.0:1787582949.078222:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162154496 00000100:00100000:2.0:1787582949.078276:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 83 00000100:00100000:2.0:1787582949.078286:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da583dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+9:13743:x1874416162154496:12345-192.168.206.20@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787582949.078310:0:14324:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787582949.078364:0:14324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787582949.078369:0:14324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787582949.078372:0:14324:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787582949.078375:0:14324:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787582949.081297:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da583dde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+9:13743:x1874416162154496:12345-192.168.206.20@tcp:256:mount.lustre.0 Request processed in 3003us (3294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582949.081361:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 83 00000100:00100000:3.0:1787582949.094658:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582949.094774:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162154624 00000100:00100000:1.0:1787582949.094783:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162154624 00000100:00100000:1.0:1787582949.094835:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 84 00000100:00100000:1.0:1787582949.094844:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+9:13743:x1874416162154624:12345-192.168.206.20@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787582949.094860:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582949.094877:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da580031600/0xa113d808b7538ff4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d583ad expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582949.094903:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da580031600/0xa113d808b7538ff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583ad expref: 10 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582949.094914:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da580031600/0xa113d808b7538ff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583ad expref: 10 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582949.094923:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580031600, rc 0) 00000100:00100000:1.0:1787582949.094975:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf388450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+10:13743:x1874416162154624:12345-192.168.206.20@tcp:101:mount.lustre.0 Request processed in 131us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582949.094982:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 84 00000100:00100000:0.0:1787582949.102847:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582949.106040:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162154752 00000100:00100000:2.0:1787582949.106055:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162154752 00000100:00100000:2.0:1787582949.106128:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 85 00000100:00100000:2.0:1787582949.106138:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+10:13743:x1874416162154752:12345-192.168.206.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787582949.106749:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf38b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+10:13743:x1874416162154752:12345-192.168.206.20@tcp:501:mount.lustre.0 Request processed in 601us (3901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582949.106759:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 85 00000100:00100000:0.0:1787582949.111942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582949.112228:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162154880 00000100:00100000:3.0:1787582949.112264:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162154880 00000100:00100000:3.0:1787582949.112389:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 86 00000100:00100000:3.0:1787582949.112402:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+10:13743:x1874416162154880:12345-192.168.206.20@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787582949.113857:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf38b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+10:13743:x1874416162154880:12345-192.168.206.20@tcp:503:mount.lustre.0 Request processed in 1446us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582949.119945:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 86 00000100:00100000:3.0:1787582949.127118:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582949.127229:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162155008 00000100:00100000:2.0:1787582949.127245:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162155008 00000100:00100000:2.0:1787582949.127377:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 87 00000100:00100000:2.0:1787582949.127389:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+10:13767:x1874416162155008:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787582949.127683:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf38a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+10:13767:x1874416162155008:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 295us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582949.127691:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 87 00000100:00100000:0.0:1787582949.134232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582949.134464:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162155136 00000100:00100000:3.0:1787582949.134485:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162155136 00000100:00100000:3.0:1787582949.134550:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 88 00000100:00100000:3.0:1787582949.134561:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+10:13767:x1874416162155136:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787582949.134840:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf737050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+10:13767:x1874416162155136:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 279us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582949.134849:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 88 00000100:00100000:0.0:1787582949.157556:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582949.157749:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162155264 00000100:00100000:2.0:1787582949.157771:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162155264 00000100:00100000:2.0:1787582949.157814:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 4 00000100:00100000:2.0:1787582949.157830:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2356:x1874416162155264:12345-192.168.206.20@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787582949.157859:0:14329:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ad19012f-cc5a-4f9c-a000-5ca876cf3856@192.168.206.20@tcp t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:2.0:1787582949.157901:0:14329:0:(genops.c:1385:class_connect()) connect: client ad19012f-cc5a-4f9c-a000-5ca876cf3856, cookie 0xa113d808b7538ffb 00000004:00100000:2.0:1787582949.157930:0:14329:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787582949.157935:0:14329:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1787582949.240970:0:14329:0:(import.c:65:import_set_state_nolock()) ffff8da5b53c0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787582949.241050:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:2356:x1874416162155264:12345-192.168.206.20@tcp:38:mount.lustre.0 Request processed in 83219us (83507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582949.241060:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 4 00000100:00100000:0.0:1787582949.243228:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582949.243314:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162155392 00000100:00100000:1.0:1787582949.243347:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162155392 00000100:00100000:1.0:1787582949.243417:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 5 00000100:00100000:1.0:1787582949.243426:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:0:x1874416162155392:12345-192.168.206.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787582949.243471:0:14331:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787582949.243562:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:0:x1874416162155392:12345-192.168.206.20@tcp:41:mount.lustre.0 Request processed in 135us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582949.243569:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 5 00000100:00080000:3.0:1787582949.244594:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582949.244756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582949.244860:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162155520 00000100:00100000:2.0:1787582949.244875:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162155520 00000100:00100000:2.0:1787582949.244955:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 6 00000100:00100000:2.0:1787582949.244964:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:13743:x1874416162155520:12345-192.168.206.20@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787582949.244987:0:14329:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787582949.246752:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:13743:x1874416162155520:12345-192.168.206.20@tcp:41:mount.lustre.0 Request processed in 83us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582949.246766:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 6 00000100:00100000:2.0:1787582949.252677:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582949.254421:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162155648 00000100:00100000:1.0:1787582949.254435:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162155648 00000100:00100000:1.0:1787582949.254700:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 7 00000100:00100000:1.0:1787582949.254712:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:13743:x1874416162155648:12345-192.168.206.20@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787582949.254801:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:13743:x1874416162155648:12345-192.168.206.20@tcp:40:mount.lustre.0 Request processed in 91us (2207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582949.254808:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 7 00000100:00100000:0.0:1787582949.260241:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582949.260279:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582949.260343:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162155776 00000100:00100000:3.0:1787582949.260352:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162155776 00000100:00100000:3.0:1787582949.260388:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162155904 00000100:00100000:3.0:1787582949.260390:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162155904 00000100:00100000:3.0:1787582949.260401:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:3.0:1787582949.260408:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1874416162155776:12345-192.168.206.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787582949.260434:0:15014:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ad19012f-cc5a-4f9c-a000-5ca876cf3856@192.168.206.20@tcp t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:3.0:1787582949.260997:0:15014:0:(genops.c:1385:class_connect()) connect: client ad19012f-cc5a-4f9c-a000-5ca876cf3856, cookie 0xa113d808b7539002 00002000:00100000:3.0:1787582949.261009:0:15014:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ad19012f-cc5a-4f9c-a000-5ca876cf3856/ffff8da5b53c6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787582949.261029:0:15014:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787582949.261307:0:15014:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1787582949.261589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582949.261748:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162156032 00000100:00100000:2.0:1787582949.261755:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162156032 00000100:00100000:2.0:1787582949.261796:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 0 00000100:00100000:2.0:1787582949.261804:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:13743:x1874416162156032:12345-192.168.206.20@tcp:33:mount.lustre.0 00000100:00080000:3.0:1787582949.262581:0:15014:0:(import.c:65:import_set_state_nolock()) ffff8da5bb7f6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787582949.262655:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad930a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:2356:x1874416162155776:12345-192.168.206.20@tcp:8:mount.lustre.0 Request processed in 2244us (2420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582949.262665:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:3.0:1787582949.262691:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00100000:3.0:1787582949.262696:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1874416162155904:12345-192.168.206.20@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787582949.262718:0:15014:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ad19012f-cc5a-4f9c-a000-5ca876cf3856@192.168.206.20@tcp t0 exp 0000000000000000 cur 490 last 0 00000020:00000080:3.0:1787582949.262743:0:15014:0:(genops.c:1385:class_connect()) connect: client ad19012f-cc5a-4f9c-a000-5ca876cf3856, cookie 0xa113d808b7539009 00002000:00100000:3.0:1787582949.262752:0:15014:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ad19012f-cc5a-4f9c-a000-5ca876cf3856/ffff8da5bb7f4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787582949.262770:0:15014:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000004:00080000:2.0:1787582949.262992:0:14332:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1041us 00002000:00080000:3.0:1787582949.263955:0:15014:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787582949.263986:0:15014:0:(import.c:65:import_set_state_nolock()) ffff8da5bb7f6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787582949.264029:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:2356:x1874416162155904:12345-192.168.206.20@tcp:8:mount.lustre.0 Request processed in 1331us (3749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582949.264038:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 10 00000004:00200000:0.0:1787582949.276708:0:14332:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787582949.276883:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:13743:x1874416162156032:12345-192.168.206.20@tcp:33:mount.lustre.0 Request processed in 15074us (15289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582949.276898:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 0 00000100:00100000:1.0:1787582949.498883:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582949.498951:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162156160 00000100:00100000:2.0:1787582949.498961:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162156160 00000100:00100000:2.0:1787582949.499019:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 8 00000100:00100000:2.0:1787582949.499029:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:13788:x1874416162156160:12345-192.168.206.20@tcp:101:mkdir.0 00010000:00010000:2.0:1787582949.499059:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582949.499082:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7539010 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d583d7 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582949.499148:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7539017 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582949.499160:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7539017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582949.499189:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7539017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582949.499393:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787582949.499397:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787582949.499501:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7539017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582949.499540:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e400/0xa113d808b7539010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583d7 expref: 8 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582949.499558:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7539017 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583d7 expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582949.499567:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:2.0:1787582949.499570:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787582949.499574:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9ec00, rc 0) 00000100:00100000:2.0:1787582949.499651:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+7:13788:x1874416162156160:12345-192.168.206.20@tcp:101:mkdir.0 Request processed in 613us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582949.499659:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 8 00000100:00100000:0.0:1787582949.968617:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3313:1874416186266880:0@lo:400:kworker.0 00000100:00100000:0.0:1787582949.968695:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582949.968754:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582949.968760:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186267392:0@lo:400:kworker.0 00000100:00100000:0.0:1787582949.968786:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582949.968812:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186267008:0@lo:400:kworker.0 00000100:00100000:0.0:1787582949.968835:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582949.968852:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582949.968857:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186267520:0@lo:400:kworker.0 00000100:00100000:0.0:1787582949.968880:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582949.968906:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186267136:0@lo:400:kworker.0 00000100:00100000:0.0:1787582949.968917:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186267008 00000100:00100000:0.0:1787582949.968923:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186267008 00000100:00100000:1.0:1787582949.968933:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582949.968948:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787582949.968953:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186266752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787582949.968963:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186267136 00000100:00100000:0.0:1787582949.968966:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186267136 00000100:00100000:1.0:1787582949.968972:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582949.968983:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787582949.968985:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186267264:0@lo:400:kworker.0 00000100:00100000:0.0:1787582949.968991:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186267008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582949.969003:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582949.969025:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186266880 00000100:00100000:1.0:1787582949.969029:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186266880 00000100:00100000:0.0:1787582949.969049:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186267008:12345-0@lo:400:kworker.0 Request processed in 46us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582949.969053:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787582949.969057:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787582949.969059:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:3313:x1874416186266880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582949.969071:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787582949.969076:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874416186267136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582949.969104:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf734050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:3313:x1874416186266880:12345-0@lo:400:kworker.0 Request processed in 45us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582949.969107:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874416186267136:12345-0@lo:400:kworker.0 Request processed in 32us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582949.969111:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787582949.969113:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787582949.969135:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186267392 00000100:00100000:1.0:1787582949.969139:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186267392 00000100:00100000:0.0:1787582949.969152:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186267136:0@lo:400:kworker.0 00000100:00100000:1.0:1787582949.969156:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186267520 00000100:00100000:1.0:1787582949.969158:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186267520 00000100:00100000:1.0:1787582949.969167:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186267264 00000100:00100000:1.0:1787582949.969170:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186267264 00000100:00100000:0.0:1787582949.969179:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186267008:0@lo:400:kworker.0 00000100:00100000:1.0:1787582949.969181:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787582949.969187:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186267392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582949.969187:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb681180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3313:1874416186266880:0@lo:400:kworker.0 00000100:00100000:1.0:1787582949.969222:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874416186267392:12345-0@lo:400:kworker.0 Request processed in 35us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582949.969228:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787582949.969240:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787582949.969246:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186267520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582949.969250:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874416186267392:0@lo:400:kworker.0 00000100:00100000:1.0:1787582949.969277:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186267520:12345-0@lo:400:kworker.0 Request processed in 32us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582949.969280:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186267520:0@lo:400:kworker.0 00000100:00100000:1.0:1787582949.969283:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787582949.969294:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787582949.969300:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186267264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582949.969354:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874416186267264:12345-0@lo:400:kworker.0 Request processed in 54us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582949.969409:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874416186267264:0@lo:400:kworker.0 00000100:00080000:3.0:1787582949.969677:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787582949.969681:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787582949.969683:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787582949.969918:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186266752 00000100:00100000:2.0:1787582949.969923:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186266752 00000100:00100000:2.0:1787582949.969949:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787582949.969956:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874416186266752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787582949.969971:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582949.970013:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874416186266752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582949.970029:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787582949.970065:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad930000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186266752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582949.970150:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000001:00080000:0.0:1787582950.038626:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1787582950.038676:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ad19012f-cc5a-4f9c-a000-5ca876cf3856 00010000:00010000:2.0:1787582950.097969:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582951.122932:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582951.416111:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582951.416219:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162156288 00000100:00100000:2.0:1787582951.416229:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162156288 00000100:00080000:3.0:1787582951.416378:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787582951.416594:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:2.0:1787582951.416607:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+7:13841:x1874416162156288:12345-192.168.206.20@tcp:41:lfs.0 00000004:00000024:2.0:1787582951.416646:0:14330:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787582951.416739:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+7:13841:x1874416162156288:12345-192.168.206.20@tcp:41:lfs.0 Request processed in 134us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582951.416746:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:3.0:1787582951.421484:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582951.421577:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162156416 00000100:00100000:1.0:1787582951.421601:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162156416 00000100:00100000:1.0:1787582951.421674:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 6 00000100:00100000:1.0:1787582951.421695:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:13841:x1874416162156416:12345-192.168.206.20@tcp:13:lfs.0 00002000:00000024:1.0:1787582951.421730:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787582951.421813:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:13841:x1874416162156416:12345-192.168.206.20@tcp:13:lfs.0 Request processed in 119us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582951.421820:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 6 00000100:00080000:3.0:1787582951.422563:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787582951.427300:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582951.428853:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162156544 00000100:00100000:2.0:1787582951.428877:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162156544 00000100:00100000:2.0:1787582951.428964:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 7 00000100:00100000:2.0:1787582951.428975:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad19012f-cc5a-4f9c-a000-5ca876cf3856+5:13841:x1874416162156544:12345-192.168.206.20@tcp:13:lfs.0 00002000:00000024:2.0:1787582951.429011:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582951.429105:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ad19012f-cc5a-4f9c-a000-5ca876cf3856+5:13841:x1874416162156544:12345-192.168.206.20@tcp:13:lfs.0 Request processed in 131us (1811us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582951.429113:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 7 00000100:00080000:3.0:1787582951.429608:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787582951.504601:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582951.504624:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186267648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582951.504689:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582951.504889:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186267648 00000100:00100000:2.0:1787582951.504897:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186267648 00000100:00100000:2.0:1787582951.504965:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787582951.504975:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186267648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582951.504995:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582951.505048:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186267648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582951.505056:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787582951.505213:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186267648:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787582951.505340:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787582951.582133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582951.582234:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162156672 00000100:00100000:2.0:1787582951.582245:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162156672 00000100:00100000:2.0:1787582951.582312:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 90 00000100:00100000:2.0:1787582951.582346:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+10:13873:x1874416162156672:12345-192.168.206.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787582951.582360:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582951.582377:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4d9f800/0xa113d808b753901e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d583de expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582951.582403:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4d9f800/0xa113d808b753901e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583de expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582951.582414:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4d9f800/0xa113d808b753901e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583de expref: 11 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582951.582423:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9f800, rc 0) 00000100:00100000:2.0:1787582951.582484:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf734c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+11:13873:x1874416162156672:12345-192.168.206.20@tcp:101:mount.lustre.0 Request processed in 141us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582951.582491:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 90 00000100:00100000:0.0:1787582951.591408:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582951.591821:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162156800 00000100:00100000:2.0:1787582951.591832:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162156800 00000100:00100000:2.0:1787582951.591940:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 91 00000100:00100000:2.0:1787582951.591950:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+11:13873:x1874416162156800:12345-192.168.206.20@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787582951.592383:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf734450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+11:13873:x1874416162156800:12345-192.168.206.20@tcp:501:mount.lustre.0 Request processed in 433us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582951.592401:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 91 00000100:00100000:3.0:1787582951.596272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582951.601391:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162156928 00000100:00100000:1.0:1787582951.601406:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162156928 00000100:00100000:2.0:1787582951.601669:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 92 00000100:00100000:2.0:1787582951.601682:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+11:13873:x1874416162156928:12345-192.168.206.20@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787582951.602887:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf735850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+11:13873:x1874416162156928:12345-192.168.206.20@tcp:503:mount.lustre.0 Request processed in 1201us (6623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582951.602899:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 92 00000100:00100000:0.0:1787582951.616931:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582951.620806:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162157056 00000100:00100000:2.0:1787582951.620823:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162157056 00000100:00100000:2.0:1787582951.620948:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 93 00000100:00100000:2.0:1787582951.620958:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+11:13880:x1874416162157056:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787582951.621350:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf736c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+11:13880:x1874416162157056:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 391us (4640us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582951.621358:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 93 00000100:00100000:3.0:1787582951.644271:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582951.644471:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162157184 00000100:00100000:1.0:1787582951.644481:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162157184 00000100:00100000:1.0:1787582951.644536:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 94 00000100:00100000:1.0:1787582951.644547:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+11:13880:x1874416162157184:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787582951.644858:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf735c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+11:13880:x1874416162157184:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 312us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582951.644866:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 94 00000100:00100000:1.0:1787582951.651955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582951.653078:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162157312 00000100:00100000:2.0:1787582951.653240:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162157312 00000100:00100000:2.0:1787582951.653307:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 95 00000100:00100000:2.0:1787582951.653352:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+11:13873:x1874416162157312:12345-192.168.206.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787582951.653366:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582951.653382:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4d9f200/0xa113d808b7539025 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58408 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582951.653406:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4d9f200/0xa113d808b7539025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58408 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582951.653416:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4d9f200/0xa113d808b7539025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58408 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582951.653436:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9f200, rc 0) 00000100:00100000:2.0:1787582951.653490:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+12:13873:x1874416162157312:12345-192.168.206.20@tcp:101:mount.lustre.0 Request processed in 174us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582951.653497:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 95 00000100:00100000:2.0:1787582951.660886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582951.661079:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162157440 00000100:00100000:0.0:1787582951.661089:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162157440 00000100:00100000:0.0:1787582951.661142:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 96 00000100:00100000:0.0:1787582951.661152:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+12:13873:x1874416162157440:12345-192.168.206.20@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787582951.661175:0:14323:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787582951.661199:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787582951.661202:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787582951.661205:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787582951.661207:0:14323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787582951.665906:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+12:13873:x1874416162157440:12345-192.168.206.20@tcp:256:mount.lustre.0 Request processed in 4745us (5019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582951.665919:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 96 00000100:00100000:1.0:1787582951.671191:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582951.671382:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162157568 00000100:00100000:2.0:1787582951.671392:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162157568 00000100:00100000:2.0:1787582951.671451:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 97 00000100:00100000:2.0:1787582951.671461:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+12:13873:x1874416162157568:12345-192.168.206.20@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787582951.671478:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582951.671494:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5b4d9f400/0xa113d808b753902c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5840f expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582951.671520:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5b4d9f400/0xa113d808b753902c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5840f expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582951.671530:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5b4d9f400/0xa113d808b753902c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5840f expref: 13 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582951.671539:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9f400, rc 0) 00000100:00100000:2.0:1787582951.671616:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+13:13873:x1874416162157568:12345-192.168.206.20@tcp:101:mount.lustre.0 Request processed in 156us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582951.671623:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 97 00000100:00100000:2.0:1787582951.676805:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582951.676954:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162157696 00000100:00100000:0.0:1787582951.676976:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162157696 00000100:00100000:0.0:1787582951.677022:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 98 00000100:00100000:0.0:1787582951.677031:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+13:13873:x1874416162157696:12345-192.168.206.20@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787582951.677293:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+13:13873:x1874416162157696:12345-192.168.206.20@tcp:501:mount.lustre.0 Request processed in 261us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582951.677301:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 98 00000100:00100000:0.0:1787582951.679364:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582951.679490:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162157824 00000100:00100000:3.0:1787582951.679499:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162157824 00000100:00100000:3.0:1787582951.679561:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 99 00000100:00100000:3.0:1787582951.679571:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+13:13873:x1874416162157824:12345-192.168.206.20@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787582951.680002:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+13:13873:x1874416162157824:12345-192.168.206.20@tcp:503:mount.lustre.0 Request processed in 430us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582951.680011:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 99 00000100:00100000:0.0:1787582951.686744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582951.686903:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162157952 00000100:00100000:2.0:1787582951.686912:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162157952 00000100:00100000:2.0:1787582951.686983:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 100 00000100:00100000:2.0:1787582951.686993:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+13:13884:x1874416162157952:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787582951.687261:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+13:13884:x1874416162157952:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 269us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582951.687270:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 100 00000100:00100000:2.0:1787582951.693853:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582951.694019:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162158080 00000100:00100000:0.0:1787582951.694029:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162158080 00000100:00100000:0.0:1787582951.694088:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 101 00000100:00100000:0.0:1787582951.694099:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+13:13884:x1874416162158080:12345-192.168.206.20@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787582951.694377:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+13:13884:x1874416162158080:12345-192.168.206.20@tcp:502:llog_process_th.0 Request processed in 279us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582951.694385:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 101 00000100:00100000:0.0:1787582951.704095:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582951.704265:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162158208 00000100:00100000:1.0:1787582951.704279:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162158208 00000100:00100000:1.0:1787582951.704371:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00100000:1.0:1787582951.704382:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2356:x1874416162158208:12345-192.168.206.20@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787582951.704422:0:14331:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 64dc23e5-ef28-4ccf-8af3-ec936b4dede7@192.168.206.20@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:1.0:1787582951.704490:0:14331:0:(genops.c:1385:class_connect()) connect: client 64dc23e5-ef28-4ccf-8af3-ec936b4dede7, cookie 0xa113d808b7539033 00000004:00100000:1.0:1787582951.704531:0:14331:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787582951.704710:0:14331:0:(import.c:65:import_set_state_nolock()) ffff8da482c00000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582951.704806:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:2356:x1874416162158208:12345-192.168.206.20@tcp:38:mount.lustre.0 Request processed in 423us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582951.704815:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00100000:3.0:1787582951.716679:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582951.716727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582951.716851:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162158336 00000100:00100000:2.0:1787582951.716867:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162158336 00000100:00100000:2.0:1787582951.716958:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162158464 00000100:00100000:2.0:1787582951.716963:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162158464 00000100:00100000:1.0:1787582951.717175:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00100000:1.0:1787582951.717196:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+7:0:x1874416162158336:12345-192.168.206.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787582951.717238:0:14331:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1787582951.717671:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582951.717871:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+7:0:x1874416162158336:12345-192.168.206.20@tcp:41:mount.lustre.0 Request processed in 681us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582951.717881:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00100000:1.0:1787582951.717914:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:1.0:1787582951.717923:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:13873:x1874416162158464:12345-192.168.206.20@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787582951.717940:0:14331:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787582951.719935:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:13873:x1874416162158464:12345-192.168.206.20@tcp:41:mount.lustre.0 Request processed in 1998us (3193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582951.719952:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:2.0:1787582951.732532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582951.737931:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162158592 00000100:00100000:1.0:1787582951.737953:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162158592 00000100:00100000:1.0:1787582951.738112:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:1.0:1787582951.738127:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:13873:x1874416162158592:12345-192.168.206.20@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787582951.738276:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:13873:x1874416162158592:12345-192.168.206.20@tcp:40:mount.lustre.0 Request processed in 152us (5757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582951.738305:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:3.0:1787582951.742895:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582951.742945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582951.742986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582951.743104:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162158720 00000100:00100000:1.0:1787582951.743117:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162158720 00000100:00100000:1.0:1787582951.743175:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162158848 00000100:00100000:1.0:1787582951.743179:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162158848 00000100:00100000:1.0:1787582951.743195:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00100000:1.0:1787582951.743204:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1874416162158720:12345-192.168.206.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787582951.743241:0:15012:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 64dc23e5-ef28-4ccf-8af3-ec936b4dede7@192.168.206.20@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:1.0:1787582951.743423:0:15012:0:(genops.c:1385:class_connect()) connect: client 64dc23e5-ef28-4ccf-8af3-ec936b4dede7, cookie 0xa113d808b753903a 00002000:00100000:1.0:1787582951.743439:0:15012:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 64dc23e5-ef28-4ccf-8af3-ec936b4dede7/ffff8da482c06000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787582951.743453:0:15012:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787582951.743777:0:15012:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787582951.743817:0:15012:0:(import.c:65:import_set_state_nolock()) ffff8da482c01000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582951.743903:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:2356:x1874416162158720:12345-192.168.206.20@tcp:8:mount.lustre.0 Request processed in 698us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582951.743912:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00100000:0.0:1787582951.744180:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162158976 00000100:00100000:0.0:1787582951.744186:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162158976 00000100:00100000:0.0:1787582951.744233:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 1 00000100:00100000:0.0:1787582951.744242:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:13873:x1874416162158976:12345-192.168.206.20@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787582951.745139:0:14333:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787582951.745453:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:1.0:1787582951.745463:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1874416162158848:12345-192.168.206.20@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787582951.745493:0:15012:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 64dc23e5-ef28-4ccf-8af3-ec936b4dede7@192.168.206.20@tcp t0 exp 0000000000000000 cur 492 last 0 00000100:00100000:0.0:1787582951.745788:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:13873:x1874416162158976:12345-192.168.206.20@tcp:33:mount.lustre.0 Request processed in 1545us (2907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582951.745807:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 1 00000020:00000080:1.0:1787582951.745859:0:15012:0:(genops.c:1385:class_connect()) connect: client 64dc23e5-ef28-4ccf-8af3-ec936b4dede7, cookie 0xa113d808b7539041 00002000:00100000:1.0:1787582951.745874:0:15012:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 64dc23e5-ef28-4ccf-8af3-ec936b4dede7/ffff8da482c03000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787582951.745886:0:15012:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787582951.746095:0:15012:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787582951.746136:0:15012:0:(import.c:65:import_set_state_nolock()) ffff8da482c04000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787582951.746506:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:2356:x1874416162158848:12345-192.168.206.20@tcp:8:mount.lustre.0 Request processed in 1042us (3518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582951.746514:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:3.0:1787582951.936618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582951.936760:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162159104 00000100:00100000:1.0:1787582951.936774:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162159104 00000100:00100000:1.0:1787582951.936855:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:1.0:1787582951.936867:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:13905:x1874416162159104:12345-192.168.206.20@tcp:101:mkdir.0 00010000:00010000:1.0:1787582951.936893:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582951.936935:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030000/0xa113d808b7539048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58439 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582951.937017:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030200/0xa113d808b753904f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582951.937034:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030200/0xa113d808b753904f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582951.937047:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030200/0xa113d808b753904f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582951.937378:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787582951.937383:0:14331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582951.937478:0:14331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030200/0xa113d808b753904f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582951.937516:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030000/0xa113d808b7539048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58439 expref: 8 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582951.937539:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030200/0xa113d808b753904f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58439 expref: 7 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582951.937557:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:1.0:1787582951.937560:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787582951.937565:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580030200, rc 0) 00000100:00100000:1.0:1787582951.937663:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+7:13905:x1874416162159104:12345-192.168.206.20@tcp:101:mkdir.0 Request processed in 797us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582951.937672:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 14 00010000:00010000:3.0:1787582952.147035:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787582952.584845:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 64dc23e5-ef28-4ccf-8af3-ec936b4dede7 00000001:00100000:1.0:1787582952.584868:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ad19012f-cc5a-4f9c-a000-5ca876cf3856 00010000:00010000:3.0:1787582953.168808:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787582954.192761:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787582954.614379:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 64dc23e5-ef28-4ccf-8af3-ec936b4dede7 00000001:00100000:1.0:1787582954.614402:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ad19012f-cc5a-4f9c-a000-5ca876cf3856 00000100:00100000:1.0:1787582955.097680:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da482a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3312:1874416186267776:0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.097779:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582955.097838:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186268288:0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.097870:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582955.097900:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787582955.097907:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186268160:0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.097929:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582955.097959:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186267904:0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.098003:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582955.098025:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186268416:0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.098052:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582955.098071:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787582955.098077:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186268032:0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.098116:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582955.098171:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186267776 00000100:00100000:1.0:1787582955.098180:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186267776 00000100:00100000:1.0:1787582955.098237:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787582955.098247:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:3312:x1874416186267776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.098304:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:3312:x1874416186267776:12345-0@lo:400:kworker.0 Request processed in 59us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582955.098312:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787582955.098384:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186268288 00000100:00100000:1.0:1787582955.098388:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186268288 00000100:00100000:1.0:1787582955.098420:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186268160 00000100:00100000:1.0:1787582955.098423:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186268160 00000100:00100000:1.0:1787582955.098435:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186268416 00000100:00100000:1.0:1787582955.098437:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186268416 00000100:00100000:1.0:1787582955.098452:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787582955.098459:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186268288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.098494:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186268288:12345-0@lo:400:kworker.0 Request processed in 35us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582955.098500:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787582955.098529:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787582955.098536:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186268160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.098564:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874416186268160:12345-0@lo:400:kworker.0 Request processed in 29us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582955.098580:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787582955.098593:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787582955.098599:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186268416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.098633:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874416186268416:12345-0@lo:400:kworker.0 Request processed in 34us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582955.098647:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787582955.098673:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186267904 00000100:00100000:1.0:1787582955.098678:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186267904 00000100:00100000:1.0:1787582955.098704:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186268032 00000100:00100000:1.0:1787582955.098707:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186268032 00000100:00100000:1.0:1787582955.098722:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787582955.098729:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186267904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.098761:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186267904:12345-0@lo:400:kworker.0 Request processed in 33us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582955.098766:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787582955.098777:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787582955.098783:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186268032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.098810:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186268032:12345-0@lo:400:kworker.0 Request processed in 27us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582955.098815:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787582955.098857:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787582955.098861:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787582955.098864:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787582955.099016:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787582955.099041:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186268032:0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.099056:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186267904:0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.099067:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874416186268416:0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.099100:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874416186268160:0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.099110:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da482a9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3312:1874416186267776:0@lo:400:kworker.0 00000100:00100000:1.0:1787582955.099132:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186268288:0@lo:400:kworker.0 00000100:00100000:0.0:1787582955.099589:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582955.099601:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186268544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787582955.099646:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582955.099706:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186268544 00000100:00100000:0.0:1787582955.099711:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186268544 00000100:00100000:0.0:1787582955.099752:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787582955.099759:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186268544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787582955.099795:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582955.099838:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186268544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582955.099844:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787582955.099884:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186268544:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787582955.131953:0:16294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1787582955.183111:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64dc23e5-ef28-4ccf-8af3-ec936b4dede7 00010000:00010000:3.0:1787582955.220925:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582956.243797:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582956.636068:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186268672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787582956.636168:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582956.636450:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186268672 00000100:00100000:2.0:1787582956.636462:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186268672 00000100:00100000:2.0:1787582956.636538:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787582956.636550:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186268672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582956.636607:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582956.636667:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186268672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582956.636675:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787582956.636833:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186268672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787582957.011154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582957.011197:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582957.011226:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582957.011248:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582957.011265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582957.011283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582957.011365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582957.011394:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162159232 00000100:00100000:3.0:1787582957.011406:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162159232 00000100:00100000:3.0:1787582957.011465:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 103 00000100:00100000:3.0:1787582957.011477:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+13:2358:x1874416162159232:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582957.011592:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+13:2358:x1874416162159232:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 117us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582957.011601:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 103 00000100:00100000:1.0:1787582957.012041:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162159360 00000100:00100000:1.0:1787582957.012048:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162159360 00000100:00100000:1.0:1787582957.012094:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162159744 00000100:00100000:1.0:1787582957.012097:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162159744 00000100:00100000:1.0:1787582957.012120:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 19 00000100:00100000:1.0:1787582957.012128:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:2357:x1874416162159360:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582957.012179:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:2357:x1874416162159360:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 52us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582957.012186:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 19 00000100:00100000:1.0:1787582957.012204:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:1.0:1787582957.012212:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:2358:x1874416162159744:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582957.012239:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:2358:x1874416162159744:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 29us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582957.012246:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:1.0:1787582957.012283:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162159488 00000100:00100000:1.0:1787582957.012288:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162159488 00000100:00100000:1.0:1787582957.012311:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162159616 00000100:00100000:1.0:1787582957.012314:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162159616 00000100:00100000:0.0:1787582957.013525:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162159872 00000100:00100000:0.0:1787582957.013538:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162159872 00000100:00100000:0.0:1787582957.013591:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162160000 00000100:00100000:0.0:1787582957.013595:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162160000 00000100:00100000:0.0:1787582957.013622:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 7 00000100:00100000:0.0:1787582957.013632:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+5:2358:x1874416162159488:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582957.013698:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+5:2358:x1874416162159488:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 68us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582957.013706:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 7 00000100:00100000:0.0:1787582957.013725:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 8 00000100:00100000:0.0:1787582957.013732:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+5:2357:x1874416162159872:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582957.013769:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+5:2357:x1874416162159872:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 38us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582957.013777:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 8 00000100:00100000:0.0:1787582957.013790:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:0.0:1787582957.013797:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+5:2358:x1874416162160000:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582957.013825:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+5:2358:x1874416162160000:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 28us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582957.013833:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:1.0:1787582957.014241:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00100000:1.0:1787582957.014250:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+5:2357:x1874416162159616:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582957.014289:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+5:2357:x1874416162159616:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 41us (3039us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582957.014297:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00080000:1.0:1787582957.014364:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787582957.014368:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787582957.014372:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787582957.268363:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582958.289463:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787582958.737609:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1787582958.764947:0:16442:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffff195700 20000000:00000080:0.0:1787582958.764969:0:16442:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8da483679400 uarg=0000000000000000 20000000:01000000:0.0:1787582958.765016:0:16442:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787582958.765024:0:16442:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787582958.765029:0:16442:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787582958.766761:0:16443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787582958.767043:0:16442:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787582958.773735:0:16442:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787582958.773830:0:16442:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8da58147f000/0xa113d808b7539056 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582958.773856:0:16442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5bb6b6e00/0xa113d808b7538d4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538d46 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582958.773866:0:16442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538d93 expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582958.773874:0:16442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5c20ee000/0xa113d808b7538ece lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7538ec7 expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582958.773909:0:16442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da580031600/0xa113d808b7538ff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583ad expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582958.773918:0:16442:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8da5b4d9f400/0xa113d808b753902c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5840f expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582958.773925:0:16442:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8da58147f000/0xa113d808b7539056 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582958.773983:0:16442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5b4d9f400/0xa113d808b753902c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5840f expref: 12 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582958.774003:0:16442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da5b4d9f400/0xa113d808b753902c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5840f expref: 12 pid: 14324 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582958.774021:0:16442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5ad932680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16442:1874416186268800:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582958.774158:0:16442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da580031600/0xa113d808b7538ff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583ad expref: 12 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582958.774167:0:16442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da580031600/0xa113d808b7538ff4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583ad expref: 12 pid: 14323 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582958.774176:0:16442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16442:1874416186268928:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582958.774209:0:16442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5c20ee000/0xa113d808b7538ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7538ec7 expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582958.774217:0:16442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da5c20ee000/0xa113d808b7538ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7538ec7 expref: 18 pid: 14321 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582958.774242:0:16442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16442:1874416186269056:0@lo:104: 00000100:00100000:0.0:1787582958.774292:0:16442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787582958.774908:0:16442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7538d93 expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582958.774920:0:16442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7538d93 expref: 18 pid: 14321 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582958.774936:0:16442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16442:1874416186269184:0@lo:104: 00000100:00100000:0.0:1787582958.774977:0:16442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787582958.775676:0:16442:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8da5bb6b6e00/0xa113d808b7538d4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa113d808b7538d46 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582958.775688:0:16442:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8da5bb6b6e00/0xa113d808b7538d4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa113d808b7538d46 expref: 18 pid: 14324 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582958.775698:0:16442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16442:1874416186269312:0@lo:104: 00000100:00100000:0.0:1787582958.775736:0:16442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582958.775768:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186269056 00000100:00100000:2.0:1787582958.775778:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186269056 00000100:00100000:1.0:1787582958.776059:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186269184 00000100:00100000:1.0:1787582958.776064:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186269184 00000100:00100000:1.0:1787582958.776094:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787582958.776105:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+4:16442:x1874416186269056:12345-0@lo:104: 00010000:00010000:1.0:1787582958.776121:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fe00/0xa113d808b7538ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7538ece expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582958.776188:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787582958.776195:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+4:16442:x1874416186269056:12345-0@lo:104: Request processed in 93us (1904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582958.776203:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787582958.776227:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787582958.776233:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+3:16442:x1874416186269184:12345-0@lo:104: 00010000:00010000:1.0:1787582958.776241:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7a00/0xa113d808b7538d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7538d9a expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582958.776275:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787582958.776281:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+3:16442:x1874416186269184:12345-0@lo:104: Request processed in 49us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582958.776287:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787582958.776371:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787582958.776380:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fe00/0xa113d808b7538ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7538ece expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.776388:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9fe00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1787582958.776393:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fe00/0xa113d808b7538ec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7538ece expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.776402:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fe00/0xa113d808b7538ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7538ece expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582958.776410:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fe00/0xa113d808b7538ec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7538ece expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582958.776416:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787582958.776451:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fe00/0xa113d808b7538ec7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538ece expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.776458:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582958.776497:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fe00/0xa113d808b7538ec7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538ece expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.776505:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5b4d9fe00/0xa113d808b7538ec7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538ece expref: -99 pid: 15733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.776518:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582958.776522:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7a00/0xa113d808b7538d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7538d9a expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.776528:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5bb6b7a00 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1787582958.776531:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7a00/0xa113d808b7538d93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7538d9a expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.776537:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7a00/0xa113d808b7538d93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7538d9a expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582958.776542:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7a00/0xa113d808b7538d93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7538d9a expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582958.776559:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787582958.776575:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7a00/0xa113d808b7538d93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538d9a expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.776581:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582958.776597:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7a00/0xa113d808b7538d93 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538d9a expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.776604:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5bb6b7a00/0xa113d808b7538d93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538d9a expref: -99 pid: 15011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.776625:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582958.776627:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582958.776629:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582958.776644:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3312:1874416186269440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787582958.776680:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582958.776727:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3313:1874416186269568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787582958.776752:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582958.776958:0:16442:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081c900 going to sleep for 11 seconds 00000100:00100000:0.0:1787582958.776983:0:16442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16442:1874416186269056:0@lo:104: 00000100:00100000:0.0:1787582958.776993:0:16442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16442:1874416186269184:0@lo:104: 00000100:00100000:3.0:1787582958.777532:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186269440 00000100:00100000:3.0:1787582958.777541:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186269440 00010000:00010000:3.0:1787582958.777587:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5c20ee000/0xa113d808b7538ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7538ec7 expref: 19 pid: 14321 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582958.777615:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186269568 00000100:00100000:3.0:1787582958.777618:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186269568 00010000:00010000:3.0:1787582958.777632:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7538d93 expref: 20 pid: 14321 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582958.777645:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787582958.777653:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+20:3312:x1874416186269440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787582958.777667:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582958.777673:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5c20ee000/0xa113d808b7538ece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7538ec7 expref: 20 pid: 14321 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.777684:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5c20ee000/0xa113d808b7538ece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7538ec7 expref: 20 pid: 14321 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.777701:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5c20ee000/0xa113d808b7538ece lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7538ec7 expref: 20 pid: 14321 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.777737:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582958.777789:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:3312:x1874416186269440:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582958.777796:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787582958.777814:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787582958.777820:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:3313:x1874416186269568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787582958.777828:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582958.777832:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7538d93 expref: 18 pid: 14321 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.777840:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7538d93 expref: 18 pid: 14321 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.777850:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5c20ee400/0xa113d808b7538d9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7538d93 expref: 18 pid: 14321 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.777858:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582958.777883:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:3313:x1874416186269568:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582958.777888:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787582958.777906:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582958.777944:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3313:1874416186269568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787582958.777977:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3312:1874416186269440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787582958.778939:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582958.778970:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582958.778995:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162160128 00000100:00100000:3.0:1787582958.779014:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162160128 00010000:00010000:3.0:1787582958.779044:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5b4d9f400/0xa113d808b753902c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5840f expref: 13 pid: 14324 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582958.779066:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162160256 00000100:00100000:3.0:1787582958.779069:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162160256 00010000:00010000:3.0:1787582958.779080:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da580031600/0xa113d808b7538ff4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583ad expref: 14 pid: 14323 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582958.779092:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 6 00000100:00100000:3.0:1787582958.779099:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad71a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58cba94b-e776-4554-b8c0-88b86365e35e+14:2359:x1874416162160128:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582958.779111:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582958.779116:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5b4d9f400/0xa113d808b753902c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5840f expref: 14 pid: 14324 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.779130:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5b4d9f400/0xa113d808b753902c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5840f expref: 14 pid: 14324 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.779151:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582958.779207:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad71a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58cba94b-e776-4554-b8c0-88b86365e35e+14:2359:x1874416162160128:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 108us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582958.779214:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 6 00000100:00100000:3.0:1787582958.779269:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 7 00000100:00100000:3.0:1787582958.779275:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58cba94b-e776-4554-b8c0-88b86365e35e+13:2359:x1874416162160256:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582958.779284:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582958.779289:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da580031600/0xa113d808b7538ff4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583ad expref: 13 pid: 14323 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.779298:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da580031600/0xa113d808b7538ff4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583ad expref: 13 pid: 14323 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.779349:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582958.779369:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58cba94b-e776-4554-b8c0-88b86365e35e+13:2359:x1874416162160256:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 95us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582958.779375:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 7 00010000:00010000:0.0:1787582958.779478:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5b4d9f400/0xa113d808b753902c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5840f expref: 12 pid: 14324 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582958.779493:0:16442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5ad932680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16442:1874416186268800:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582958.779504:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da580031600/0xa113d808b7538ff4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583ad expref: 11 pid: 14323 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582958.779535:0:16442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16442:1874416186268928:192.168.206.20@tcp:104: 00000100:00100000:2.0:1787582958.779677:0:14313:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787582958.779690:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186269312 00000100:00100000:2.0:1787582958.779694:0:14313:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186269312 00000100:00100000:2.0:1787582958.779719:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787582958.779727:0:14313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da586c7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+3:16442:x1874416186269312:12345-0@lo:104: 00010000:00010000:2.0:1787582958.779748:0:14313:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7538d46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7538d4d expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582958.779880:0:16442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16442:1874416186269312:0@lo:104: 00010000:00010000:0.0:1787582958.779921:0:16442:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8da58147f000/0xa113d808b7539056 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582958.780698:0:14313:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787582958.780710:0:14313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da586c7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+3:16442:x1874416186269312:12345-0@lo:104: Request processed in 982us (4972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582958.780720:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1787582958.781610:0:14318:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787582958.781623:0:14318:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7538d46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa113d808b7538d4d expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.781634:0:14318:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5c20ee200 already unused, calling callback (ffffffffc1dc4c20) 10000000:00010000:3.0:1787582958.781638:0:14318:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7538d46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa113d808b7538d4d expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.781649:0:14318:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7538d46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa113d808b7538d4d expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787582958.781656:0:14318:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7538d46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa113d808b7538d4d expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582958.781661:0:14318:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787582958.781838:0:14318:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7538d46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538d4d expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.781847:0:14318:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787582958.781887:0:14318:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7538d46 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538d4d expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.781894:0:14318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.120@tcp lock: ffff8da5c20ee200/0xa113d808b7538d46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa113d808b7538d4d expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.781937:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582958.781940:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582958.781942:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582958.781952:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787582958.781975:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3313:1874416186269696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787582958.782053:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582958.782413:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186269696 00000100:00100000:3.0:1787582958.782424:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186269696 00010000:00010000:3.0:1787582958.782464:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8da5bb6b6e00/0xa113d808b7538d4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7538d46 expref: 17 pid: 14324 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582958.782505:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787582958.782512:0:14315:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787582958.782514:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:3313:x1874416186269696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787582958.782642:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582958.782649:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8da5bb6b6e00/0xa113d808b7538d4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa113d808b7538d46 expref: 17 pid: 14324 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582958.782688:0:14315:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787582958.782731:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8da5bb6b6e00/0xa113d808b7538d4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa113d808b7538d46 expref: 17 pid: 14324 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.782752:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da5bb6b6e00/0xa113d808b7538d4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa113d808b7538d46 expref: 17 pid: 14324 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.782774:0:14316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8da58147f000/0xa113d808b7539056 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.782783:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da58147f000/0xa113d808b7539056 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.782801:0:14316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da58147f000/0xa113d808b7539056 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.782808:0:14316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8da58147f000/0xa113d808b7539056 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.782825:0:14316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8da58147f000/0xa113d808b7539056 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.782833:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8da58147f000/0xa113d808b7539056 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.782838:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147f000 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:3.0:1787582958.782843:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8da58147f000/0xa113d808b7539056 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.782851:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8da58147f000/0xa113d808b7539056 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.782872:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8da58147f000/0xa113d808b7539056 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582958.782883:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582958.782934:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:3313:x1874416186269696:12345-0@lo:103:ldlm_bl.0 Request processed in 420us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582958.782942:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787582958.783002:0:16442:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8da58147f000/0xa113d808b7539056 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582958.783012:0:16442:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8da58147f000/0xa113d808b7539056 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582958.783019:0:16442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8da58147f000/0xa113d808b7539056 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16442 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582958.783514:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3313:1874416186269696:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787582959.313861:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787582960.208614:0:14326:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787582960.208630:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da5bb7f1000 from 10 10000000:01000000:1.0:1787582960.208635:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787582960.208675:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da580031600/0xa113d808b753905d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582960.208770:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186269952:0@lo:400:kworker.0 00000100:00100000:3.0:1787582960.208859:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582960.208920:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186270592:0@lo:400:kworker.0 00000100:00100000:3.0:1787582960.208954:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582960.208982:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787582960.208988:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3312:1874416186269824:0@lo:400:kworker.0 00000100:00100000:3.0:1787582960.209030:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787582960.209128:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da580031600/0xa113d808b753905d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582960.209144:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da580031600/0xa113d808b753905d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582960.209162:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186270208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787582960.209193:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582960.209219:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5857ce900 going to sleep for 11 seconds 00000100:00100000:1.0:1787582960.209244:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186269952 00000100:00100000:1.0:1787582960.209251:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186269952 00000100:00100000:1.0:1787582960.209314:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787582960.209354:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186269952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582960.209410:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874416186269952:12345-0@lo:400:kworker.0 Request processed in 58us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582960.209417:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787582960.209444:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186270592 00000100:00100000:1.0:1787582960.209448:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186270592 00000100:00100000:1.0:1787582960.209477:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787582960.209484:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186270592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582960.209591:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186270592:12345-0@lo:400:kworker.0 Request processed in 108us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582960.209598:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787582960.209618:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186269824 00000100:00100000:1.0:1787582960.209628:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186269824 00000100:00100000:1.0:1787582960.209652:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186270208 00000100:00100000:1.0:1787582960.209655:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186270208 00000100:00100000:1.0:1787582960.209666:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787582960.209672:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:3312:x1874416186269824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582960.209703:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:3312:x1874416186269824:12345-0@lo:400:kworker.0 Request processed in 31us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582960.209709:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787582960.209731:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787582960.209737:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+16:14326:x1874416186270208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582960.209746:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582960.209763:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da580030000/0xa113d808b7539064 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b753905d expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582960.209787:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da580030000/0xa113d808b7539064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b753905d expref: 17 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582960.209799:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da580030000/0xa113d808b7539064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b753905d expref: 17 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582960.209810:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da580030000, rc 0) 00000100:00100000:1.0:1787582960.209836:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:14326:x1874416186270208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582960.209842:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1787582960.209866:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787582960.209872:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787582960.209910:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186270208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582960.209928:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da580031600/0xa113d808b753905d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7539064 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582960.209945:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da580031600/0xa113d808b753905d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7539064 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582960.210011:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186270720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582960.210039:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582960.210178:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3312:1874416186269824:0@lo:400:kworker.0 00000100:00100000:3.0:1787582960.210185:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186270464:0@lo:400:kworker.0 00000100:00100000:3.0:1787582960.210209:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582960.210235:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874416186269952:0@lo:400:kworker.0 00000100:00100000:3.0:1787582960.210245:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186270592:0@lo:400:kworker.0 00000100:00100000:3.0:1787582960.210270:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186270080:0@lo:400:kworker.0 00000100:00100000:3.0:1787582960.210293:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582960.210328:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787582960.210335:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186270336:0@lo:400:kworker.0 00000100:00100000:3.0:1787582960.210359:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582960.210398:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186270080 00000100:00100000:3.0:1787582960.210402:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186270080 00000100:00100000:3.0:1787582960.210432:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787582960.210440:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186270080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582960.210473:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186270080:12345-0@lo:400:kworker.0 Request processed in 34us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582960.210479:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787582960.210501:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186270080:0@lo:400:kworker.0 00000100:00100000:2.0:1787582960.211257:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787582960.211277:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186270848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787582960.211594:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787582960.211619:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186270464 00000100:00100000:1.0:1787582960.211625:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186270464 00000100:00100000:1.0:1787582960.211667:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186270336 00000100:00100000:1.0:1787582960.211670:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186270336 00000100:00100000:1.0:1787582960.211683:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787582960.211690:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186270464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582960.211756:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874416186270464:12345-0@lo:400:kworker.0 Request processed in 66us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582960.211762:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787582960.211775:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787582960.211780:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186270336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787582960.211801:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874416186270336:12345-0@lo:400:kworker.0 Request processed in 21us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582960.211807:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787582960.211826:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787582960.211831:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787582960.211844:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186270720 00000100:00100000:1.0:1787582960.211847:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186270720 00000100:00100000:1.0:1787582960.211866:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787582960.211872:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:14326:x1874416186270720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787582960.213064:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582960.213145:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186270848 00000100:00100000:2.0:1787582960.213152:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186270848 00000100:00100000:2.0:1787582960.213203:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787582960.213212:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186270848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787582960.213252:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582960.217455:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874416186270464:0@lo:400:kworker.0 00000100:00100000:2.0:1787582960.217739:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874416186270848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4524us (4674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582960.217751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582960.217753:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787582960.217843:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186270848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787582960.217951:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874416186270336:0@lo:400:kworker.0 00000100:00100000:0.0:1787582960.218036:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162160384 00000100:00100000:0.0:1787582960.218055:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162160384 00000100:00100000:0.0:1787582960.218217:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 107 00000100:00100000:0.0:1787582960.218228:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+11:13757:x1874416162160384:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787582960.218245:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582960.218274:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da58147f000/0xa113d808b753906b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58440 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582960.218590:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da58147f000/0xa113d808b753906b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58440 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582960.218603:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da58147f000/0xa113d808b753906b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58440 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582960.218613:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147f000, rc 0) 00000100:00100000:0.0:1787582960.218772:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+12:13757:x1874416162160384:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 Request processed in 545us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582960.218780:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 107 00000100:00100000:3.0:1787582960.223848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582960.223896:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162160512 00000100:00100000:3.0:1787582960.223920:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162160512 00000100:00100000:3.0:1787582960.223981:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 108 00000100:00100000:3.0:1787582960.223993:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+12:13757:x1874416162160512:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582960.224385:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:14326:x1874416186270720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 12508us (14341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582960.224395:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787582960.224464:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186270720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582960.224744:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186270976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787582960.224804:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582960.224848:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da482c1d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787582960.224952:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186270976 00000100:00100000:0.0:1787582960.224958:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186270976 00000100:00100000:0.0:1787582960.224985:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787582960.224992:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:14326:x1874416186270976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582960.225799:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:14326:x1874416186270976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 803us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582960.225810:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787582960.225863:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186270976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582960.226752:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+12:13757:x1874416162160512:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 Request processed in 2754us (2909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582960.226766:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 108 00000100:00100000:3.0:1787582960.233844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582960.233890:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162160640 00000100:00100000:3.0:1787582960.233903:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162160640 00000100:00100000:3.0:1787582960.233966:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 110 00000100:00100000:3.0:1787582960.233978:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b6cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+12:13757:x1874416162160640:12345-192.168.206.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582960.234260:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b6cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+12:13757:x1874416162160640:12345-192.168.206.20@tcp:503:ll_cfg_requeue.0 Request processed in 283us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582960.234269:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 110 00000040:00080000:1.0:1787582960.239686:0:16509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787582960.241420:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787582960.241462:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787582960.241475:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da580031600/0xa113d808b753905d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7539064 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582960.241490:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da580031600/0xa113d808b753905d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7539064 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787582960.241502:0:14326:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787582960.241505:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da5bf27a800 from 10 10000000:01000000:1.0:1787582960.241508:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787582960.241565:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da580031400/0xa113d808b7539072 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582960.241573:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da580031400/0xa113d808b7539072 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582960.241586:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da580031400/0xa113d808b7539072 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582960.241617:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186271104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787582960.241718:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582960.241770:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a052fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787582960.241853:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186271104 00000100:00100000:3.0:1787582960.241864:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186271104 00000100:00100000:3.0:1787582960.241981:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787582960.241993:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf31b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+17:14326:x1874416186271104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582960.242009:0:14324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582960.242024:0:14324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5a08d0600/0xa113d808b7539079 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7539072 expref: -99 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582960.242273:0:14324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5a08d0600/0xa113d808b7539079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7539072 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582960.242288:0:14324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5a08d0600/0xa113d808b7539079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7539072 expref: 18 pid: 14324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582960.242311:0:14324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0600, rc 0) 00000100:00100000:3.0:1787582960.242391:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf31b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:14326:x1874416186271104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 400us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582960.242398:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787582960.242510:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186271104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787582960.242526:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da580031400/0xa113d808b7539072 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7539079 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582960.242536:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da580031400/0xa113d808b7539072 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b7539079 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582960.243670:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582960.243710:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162160768 00000100:00100000:3.0:1787582960.243719:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162160768 00000100:00100000:3.0:1787582960.243767:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 112 00000100:00100000:3.0:1787582960.243777:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf319c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+12:13757:x1874416162160768:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582960.243794:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582960.243812:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5a08d1800/0xa113d808b7539080 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58447 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582960.243838:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5a08d1800/0xa113d808b7539080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58447 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582960.243849:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5a08d1800/0xa113d808b7539080 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58447 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582960.243859:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1800, rc 0) 00000100:00100000:3.0:1787582960.243913:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf319c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+13:13757:x1874416162160768:12345-192.168.206.20@tcp:101:ll_cfg_requeue.0 Request processed in 137us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582960.243920:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 112 00000100:00100000:1.0:1787582960.245597:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186271232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787582960.245669:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582960.245716:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a052fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787582960.245787:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186271232 00000100:00100000:3.0:1787582960.245794:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186271232 00000100:00100000:3.0:1787582960.245844:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787582960.245854:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:14326:x1874416186271232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582960.246186:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf318850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:14326:x1874416186271232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 332us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582960.246194:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787582960.246244:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186271232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582960.246280:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186271360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582960.246356:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582960.246371:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58133a000 going to sleep for 11 seconds 00000100:00100000:3.0:1787582960.246385:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186271360 00000100:00100000:3.0:1787582960.246389:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186271360 00000100:00100000:3.0:1787582960.246409:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787582960.246415:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:14326:x1874416186271360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582960.246579:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf318050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:14326:x1874416186271360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582960.246586:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787582960.246620:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186271360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582960.248979:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582960.249020:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162160896 00000100:00100000:3.0:1787582960.249031:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162160896 00000100:00100000:3.0:1787582960.249097:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 115 00000100:00100000:3.0:1787582960.249108:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bf31a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+13:13757:x1874416162160896:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582960.249443:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bf31a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58cba94b-e776-4554-b8c0-88b86365e35e+13:13757:x1874416162160896:12345-192.168.206.20@tcp:501:ll_cfg_requeue.0 Request processed in 336us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582960.249452:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 115 00000040:00080000:3.0:1787582960.254755:0:16510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:3.0:1787582960.254923:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582960.257420:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162161024 00000100:00100000:3.0:1787582960.257442:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162161024 00000100:00100000:3.0:1787582960.257509:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 116 00000100:00100000:3.0:1787582960.257521:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+13:13757:x1874416162161024:12345-192.168.206.20@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582960.257804:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+13:13757:x1874416162161024:12345-192.168.206.20@tcp:503:ll_cfg_requeue.0 Request processed in 284us (2885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582960.257814:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 116 00000020:01000000:3.0:1787582960.273210:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787582960.273260:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787582960.273274:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da580031400/0xa113d808b7539072 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7539079 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582960.273288:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da580031400/0xa113d808b7539072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b7539079 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787582960.273301:0:14326:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787582960.273304:0:14326:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8da5ad665000 from 10 10000000:01000000:3.0:1787582960.273308:0:14326:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787582960.273485:0:14326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1600/0xa113d808b7539087 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582960.273495:0:14326:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1600/0xa113d808b7539087 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582960.273508:0:14326:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1600/0xa113d808b7539087 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582960.273619:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186271488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787582960.273714:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582960.273770:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58921df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787582960.273797:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186271488 00000100:00100000:3.0:1787582960.273806:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186271488 00000100:00100000:3.0:1787582960.273861:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787582960.273873:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+18:14326:x1874416186271488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582960.273890:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582960.273905:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8da5a08d0e00/0xa113d808b753908e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa113d808b7539087 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582960.273933:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8da5a08d0e00/0xa113d808b753908e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa113d808b7539087 expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582960.273946:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8da5a08d0e00/0xa113d808b753908e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa113d808b7539087 expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582960.273957:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0e00, rc 0) 00000100:00100000:3.0:1787582960.274000:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:14326:x1874416186271488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582960.274009:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787582960.274644:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186271488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787582960.274667:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1600/0xa113d808b7539087 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b753908e expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582960.274679:0:14326:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1600/0xa113d808b7539087 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa113d808b753908e expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582960.274753:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da58b3ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186271616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582960.274812:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582960.274842:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58921df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787582960.274874:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186271616 00000100:00100000:3.0:1787582960.274879:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186271616 00000100:00100000:3.0:1787582960.274911:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787582960.274920:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:14326:x1874416186271616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787582960.277213:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:14326:x1874416186271616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2282us (2389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582960.277230:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787582960.277956:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da58b3ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186271616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787582960.278031:0:14326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186271744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787582960.278100:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582960.278147:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186271744 00000100:00100000:0.0:1787582960.278149:0:14326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a081cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787582960.278156:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186271744 00000100:00100000:3.0:1787582960.278214:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787582960.278225:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:14326:x1874416186271744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787582960.279724:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:14326:x1874416186271744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1492us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582960.279739:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787582960.279859:0:14326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:3e2cf41e-7ffc-455b-9803-c6c5675ba817:14326:1874416186271744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787582960.281145:0:16513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787582960.281232:0:14326:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787582960.281260:0:14326:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.120@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787582960.281273:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1600/0xa113d808b7539087 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b753908e expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582960.281296:0:14326:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.120@tcp lock: ffff8da5a08d1600/0xa113d808b7539087 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa113d808b753908e expref: -99 pid: 14326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582960.342435:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582961.360544:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787582961.744734:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787582961.744758:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186271872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787582961.744839:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582961.745058:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186271872 00000100:00100000:2.0:1787582961.745067:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186271872 00000100:00100000:2.0:1787582961.745116:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787582961.745127:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186271872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787582961.745161:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787582961.745215:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186271872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582961.745251:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787582961.745394:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186271872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787582962.130940:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582962.130980:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582962.131020:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162161152 00000100:00100000:3.0:1787582962.131023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582962.131039:0:14323:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162161152 00000100:00100000:3.0:1787582962.131068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582962.131136:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162161664 00000100:00100000:0.0:1787582962.131144:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 120 00000100:00100000:2.0:1787582962.131147:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162161664 00000100:00100000:1.0:1787582962.131147:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162161408 00000100:00100000:1.0:1787582962.131153:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162161408 00000100:00100000:0.0:1787582962.131162:0:14323:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+13:2357:x1874416162161152:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582962.131204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582962.131210:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162161920 00000100:00100000:1.0:1787582962.131213:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162161920 00000100:00100000:0.0:1787582962.131280:0:14323:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58cba94b-e776-4554-b8c0-88b86365e35e+13:2357:x1874416162161152:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 123us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582962.131294:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 120 00000100:00100000:0.0:1787582962.131406:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:0.0:1787582962.131416:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+5:2357:x1874416162161408:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582962.134215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582962.135971:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162161280 00000100:00100000:2.0:1787582962.135985:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162161280 00000100:00100000:2.0:1787582962.136018:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 24 00000100:00100000:2.0:1787582962.136029:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:2357:x1874416162161664:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582962.136122:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:2357:x1874416162161664:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 94us (5101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582962.136130:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 24 00000100:00100000:2.0:1787582962.136149:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 25 00000100:00100000:2.0:1787582962.136156:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:2357:x1874416162161280:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582962.136179:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:2357:x1874416162161280:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 25us (4979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582962.136186:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 25 00000100:00100000:2.0:1787582962.136239:0:15013:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787582962.136247:0:15013:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:0.0:1787582962.136494:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787582962.136505:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787582962.136508:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787582962.136555:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+5:2357:x1874416162161408:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 5134us (5567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582962.136568:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:0.0:1787582962.136598:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162161536 00000100:00100000:0.0:1787582962.136605:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162161536 00000100:00080000:0.0:1787582962.136627:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787582962.136667:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:0.0:1787582962.136674:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+5:2357:x1874416162161536:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:0.0:1787582962.136716:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+5:2357:x1874416162161536:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 43us (2511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582962.136722:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:2.0:1787582962.138949:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582962.139048:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162161792 00000100:00100000:3.0:1787582962.139057:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162161792 00000100:00100000:3.0:1787582962.139129:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 15 00000100:00100000:3.0:1787582962.139139:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+5:2357:x1874416162161792:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582962.139203:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+5:2357:x1874416162161792:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 66us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582962.139211:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 15 00000100:00080000:2.0:1787582962.139765:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787582962.140891:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:1.0:1787582962.140905:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+5:2357:x1874416162161920:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:1.0:1787582962.140968:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+5:2357:x1874416162161920:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 67us (9901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582962.140975:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 16 00010000:00010000:0.0:1787582962.384691:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582962.544731:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582962.544849:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162162048 00000100:00100000:1.0:1787582962.544859:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162162048 00000100:00100000:1.0:1787582962.544959:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 15 00000100:00100000:1.0:1787582962.544970:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:14415:x1874416162162048:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787582962.545003:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582962.545036:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b7539095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5844e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.545103:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87600/0xa113d808b753909c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.545118:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87600/0xa113d808b753909c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.545130:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87600/0xa113d808b753909c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.545144:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.545151:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.545157:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546011:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86000/0xa113d808b75390aa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546025:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86000/0xa113d808b75390aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546034:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86000/0xa113d808b75390aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582962.546127:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787582962.546136:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582962.546236:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86000/0xa113d808b75390aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546248:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87600/0xa113d808b753909c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546254:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87600/0xa113d808b753909c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546261:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87600/0xa113d808b753909c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546592:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d87600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582962.546597:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87600/0xa113d808b753909c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546605:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87600/0xa113d808b753909c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546619:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:1.0:1787582962.546621:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582962.546626:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87600/0xa113d808b753909c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546631:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87600/0xa113d808b753909c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546644:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546649:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546665:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546747:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d86a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582962.546750:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546756:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546764:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8da5a4b29a00) 00010000:00010000:1.0:1787582962.546766:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582962.546769:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546774:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546809:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b7539095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5844e expref: 8 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546822:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86000/0xa113d808b75390aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5844e expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.546829:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8da5a4b29300) 00010000:00010000:1.0:1787582962.546830:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787582962.546832:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d86000, rc 0) 00000100:00100000:1.0:1787582962.546943:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+7:14415:x1874416162162048:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 1974us (2284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582962.546967:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 15 00000100:00100000:2.0:1787582962.555771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582962.556075:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162162304 00000100:00100000:0.0:1787582962.556086:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162162304 00000100:00100000:0.0:1787582962.556148:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:0.0:1787582962.556158:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+7:14415:x1874416162162304:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787582962.556178:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582962.556200:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b75390b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58455 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.556280:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390b8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.556294:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.556308:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.556363:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.556372:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.556379:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.557261:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fc00/0xa113d808b75390c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.557288:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fc00/0xa113d808b75390c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.557296:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fc00/0xa113d808b75390c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582962.557306:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787582962.559656:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.559748:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390b8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.559756:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.559762:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147fa00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582962.559767:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.559774:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390b8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.559789:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8da5a4b29300) 00010000:00010000:0.0:1787582962.559792:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582962.559797:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.559815:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.559830:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.559836:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390bf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.559842:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.559847:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582962.559849:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.559855:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390bf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.559861:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8da5a0b68900) 00010000:00010000:0.0:1787582962.559864:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582962.559866:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390bf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.559871:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.564307:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b75390b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58455 expref: 10 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.564484:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fc00/0xa113d808b75390c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58455 expref: 9 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.564494:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8da5a0b68200) 00010000:00010000:0.0:1787582962.565144:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582962.565150:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147fc00, rc 0) 00000100:00100000:0.0:1787582962.565243:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+9:14415:x1874416162162304:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 9083us (9476us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787582962.565251:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:3.0:1787582962.582147:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582962.583787:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162162432 00000100:00100000:1.0:1787582962.583802:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162162432 00000100:00100000:1.0:1787582962.583936:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 17 00000100:00100000:1.0:1787582962.583947:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+9:14415:x1874416162162432:12345-192.168.206.20@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787582962.584072:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+9:14415:x1874416162162432:12345-192.168.206.20@tcp:59:lhsmtool_posix.0 Request processed in 119us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582962.584080:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 17 00000100:00100000:3.0:1787582962.666289:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582962.667577:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162162560 00000100:00100000:0.0:1787582962.667589:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162162560 00000100:00100000:0.0:1787582962.667649:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 18 00000100:00100000:0.0:1787582962.667660:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da58b3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+9:14421:x1874416162162560:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582962.667679:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582962.667699:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b75390d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5845c expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.667762:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.667776:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.667786:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.667800:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.667834:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.667842:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668092:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668101:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668108:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668114:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582962.668119:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668126:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668138:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:0.0:1787582962.668141:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582962.668145:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668151:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75390db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668163:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668174:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668181:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668186:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147fa00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582962.668189:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668195:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668203:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8da5a0b68900) 00010000:00010000:0.0:1787582962.668206:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582962.668209:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668214:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b75390e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668246:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b75390d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5845c expref: 10 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668256:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:0.0:1787582962.668258:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582962.668262:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b75390d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5845c expref: 10 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.668298:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147ec00, rc 0) 00000100:00100000:0.0:1787582962.668434:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da58b3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+9:14421:x1874416162162560:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 775us (2165us total) trans 0 rc 301/301 00000100:00100000:0.0:1787582962.668442:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 18 00000100:00100000:2.0:1787582962.685640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582962.685796:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162162688 00000100:00100000:3.0:1787582962.685805:0:14338:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162162688 00000100:00100000:3.0:1787582962.685861:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 0 00000100:00100000:3.0:1787582962.685871:0:14338:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+9:14421:x1874416162162688:12345-192.168.206.20@tcp:700:lfs.0 00000100:00100000:3.0:1787582962.685951:0:14338:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+9:14421:x1874416162162688:12345-192.168.206.20@tcp:700:lfs.0 Request processed in 82us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582962.685958:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 0 00000100:00100000:3.0:1787582962.689652:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582962.689813:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162162944 00000100:00100000:1.0:1787582962.689823:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162162944 00000100:00100000:1.0:1787582962.689883:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 19 00000100:00100000:1.0:1787582962.689894:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+9:14421:x1874416162162944:12345-192.168.206.20@tcp:36:lfs.0 00010000:00010000:1.0:1787582962.689948:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582962.689972:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b7539017 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d583d7 expref: 9 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.689991:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:1.0:1787582962.689996:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787582962.690257:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.690272:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030200/0xa113d808b753904f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58439 expref: 5 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.690282:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390e9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.690382:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030200/0xa113d808b753904f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58439 expref: 5 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.690397:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030200/0xa113d808b753904f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58439 expref: 5 pid: 14331 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582962.690411:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874416186272000:192.168.206.20@tcp:104: 00000100:00100000:1.0:1787582962.690507:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da585334b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787582962.694732:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874416186272000:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582962.694761:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582962.695337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582962.695432:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162163072 00000100:00100000:2.0:1787582962.695439:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162163072 00010000:00010000:2.0:1787582962.695471:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030200/0xa113d808b753904f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58439 expref: 6 pid: 14331 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582962.695542:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:2.0:1787582962.695552:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:2360:x1874416162163072:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582962.695567:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582962.695575:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030200/0xa113d808b753904f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58439 expref: 6 pid: 14331 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582962.695588:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030200/0xa113d808b753904f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58439 expref: 6 pid: 14331 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582962.695609:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da580030200/0xa113d808b753904f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58439 expref: 6 pid: 14331 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582962.695624:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:2.0:1787582962.695629:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582962.695637:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582962.695644:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390e9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582962.695673:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582962.695730:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+5:2360:x1874416162163072:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 179us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582962.695737:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 9 00010000:00010000:1.0:1787582962.696380:0:14329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.696390:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.696413:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390f0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.696435:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.696452:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582962.697839:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787582962.697860:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.697868:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390e9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.697876:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.697882:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d87200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582962.697886:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.697893:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390e9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.697907:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4492200) 00010000:00010000:1.0:1787582962.697909:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582962.697913:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390e9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.697919:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787582962.697937:0:14329:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000595fe070 reply state 000000002f690a47 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582962.697945:0:14329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787582962.698032:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+10:14421:x1874416162162944:12345-192.168.206.20@tcp:36:lfs.0 Request processed in 8137us (8386us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787582962.698041:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 19 00010000:00010000:2.0:1787582962.705983:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582962.706013:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390f0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582962.706021:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390f0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582962.706028:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d86a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582962.706033:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390f0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582962.706041:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390f0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582962.706057:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8da5a4b29a00) 00010000:00010000:2.0:1787582962.706060:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582962.706065:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390f0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582962.706072:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b75390f0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582962.787758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582962.789675:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162163200 00000100:00100000:1.0:1787582962.789707:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162163200 00000100:00100000:1.0:1787582962.789779:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:1.0:1787582962.789800:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+9:14429:x1874416162163200:12345-192.168.206.20@tcp:101:lctl.0 00010000:00010000:1.0:1787582962.789823:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582962.789845:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58463 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.789919:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87600/0xa113d808b75390fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.789932:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87600/0xa113d808b75390fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.789943:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87600/0xa113d808b75390fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582962.790005:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787582962.790009:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582962.790046:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87600/0xa113d808b75390fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.790068:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75390f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58463 expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.790084:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87600/0xa113d808b75390fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58463 expref: 10 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.790091:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4b29100) 00010000:00010000:1.0:1787582962.790094:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787582962.790097:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d87600, rc 0) 00000100:00100000:1.0:1787582962.790163:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+10:14429:x1874416162163200:12345-192.168.206.20@tcp:101:lctl.0 Request processed in 366us (2415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582962.790170:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:3.0:1787582962.816639:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582962.816705:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162163328 00000100:00100000:1.0:1787582962.816714:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162163328 00000100:00100000:1.0:1787582962.816773:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 21 00000100:00100000:1.0:1787582962.816794:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+5:14430:x1874416162163328:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:1.0:1787582962.816813:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582962.816830:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b7539105 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5846a expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.816902:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87400/0xa113d808b753910c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.816915:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87400/0xa113d808b753910c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.816926:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87400/0xa113d808b753910c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582962.816992:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787582962.816996:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582962.817020:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87400/0xa113d808b753910c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.817045:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b7539105 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5846a expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.817064:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87400/0xa113d808b753910c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5846a expref: 6 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.817088:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4b29100) 00010000:00010000:1.0:1787582962.817090:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787582962.817093:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d87400, rc 0) 00000100:00100000:1.0:1787582962.817154:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad9ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:14430:x1874416162163328:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 370us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582962.817160:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 21 00000100:00100000:2.0:1787582962.820682:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582962.820775:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162163456 00000100:00100000:0.0:1787582962.820793:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162163456 00000100:00100000:0.0:1787582962.820847:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 22 00000100:00100000:0.0:1787582962.820856:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:14430:x1874416162163456:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582962.820875:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582962.820904:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b7539113 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58471 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.820975:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753911a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.820990:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753911a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821001:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753911a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821240:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539121 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821251:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539121 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821275:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539121 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821413:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539128 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821422:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539128 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821429:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539128 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582962.821468:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787582962.821472:0:14331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582962.821497:0:14331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539128 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821509:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753911a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821515:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753911a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821663:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753911a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821671:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582962.821676:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753911a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821682:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753911a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821699:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4b29100) 00010000:00010000:0.0:1787582962.821702:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582962.821706:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753911a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821712:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753911a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821725:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539121 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821731:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539121 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821736:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539121 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821741:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582962.821744:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539121 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821750:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539121 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821757:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8da5a0b68900) 00010000:00010000:0.0:1787582962.821760:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582962.821762:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539121 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.821767:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539121 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.822084:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b7539113 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58471 expref: 8 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.822104:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539128 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58471 expref: 7 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.822112:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8da5a0b68f00) 00010000:00010000:0.0:1787582962.822114:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787582962.822116:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147ec00, rc 0) 00000100:00100000:0.0:1787582962.822179:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+7:14430:x1874416162163456:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 1324us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582962.822186:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 22 00000100:00100000:3.0:1787582962.831491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000040:00080000:2.0:1787582962.835476:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787582962.838248:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162163712 00000100:00100000:0.0:1787582962.838262:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162163712 00000100:00100000:0.0:1787582962.838452:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 23 00000100:00100000:0.0:1787582962.838463:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+7:14430:x1874416162163712:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582962.838481:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582962.838511:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b753912f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58478 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582962.838623:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787582962.838737:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b753912f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58478 expref: 9 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.838751:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4b29100) 00010000:00010000:0.0:1787582962.838755:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787582962.838771:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b753912f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58478 expref: 9 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.838799:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147fa00, rc 0) 00000100:00100000:0.0:1787582962.838982:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+8:14430:x1874416162163712:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 520us (7499us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787582962.838989:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 23 00000100:00100000:3.0:1787582962.850366:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582962.850520:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162163968 00000100:00100000:0.0:1787582962.850542:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162163968 00000100:00100000:0.0:1787582962.850592:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 24 00000100:00100000:0.0:1787582962.850601:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+8:14430:x1874416162163968:12345-192.168.206.20@tcp:36:lfs.0 00010000:00010000:0.0:1787582962.850648:0:14331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582962.850671:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539128 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58471 expref: 8 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.850688:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8da5a0b68f00) 00010000:00010000:0.0:1787582962.850697:0:14331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787582962.850716:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b753913d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.850728:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b753913d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.850736:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b753913d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787582962.850927:0:14331:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098035146 reply state 00000000a8383e3a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b753913d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582962.850936:0:14331:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787582962.850957:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1787582962.851037:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+9:14430:x1874416162163968:12345-192.168.206.20@tcp:36:lfs.0 Request processed in 436us (678us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787582962.851045:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 24 00000100:00100000:2.0:1787582962.858012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00010000:00010000:0.0:1787582962.858176:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b753913d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.858188:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b753913d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.858195:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b753913d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.858201:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147fa00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582962.858206:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b753913d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.858213:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b753913d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.858228:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8da5a0b68900) 00010000:00010000:0.0:1787582962.858231:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1787582962.858235:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b753913d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.858241:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b753913d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582962.858356:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162164224 00000100:00100000:3.0:1787582962.858364:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162164224 00000100:00100000:3.0:1787582962.858409:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 2 00000100:00100000:3.0:1787582962.858419:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+8:14430:x1874416162164224:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:3.0:1787582962.858660:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+9:14430:x1874416162164224:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 242us (655us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787582962.858676:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 2 00000100:00100000:3.0:1787582962.862180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582962.862267:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162164480 00000100:00100000:0.0:1787582962.862277:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162164480 00000100:00100000:0.0:1787582962.862364:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 25 00000100:00100000:0.0:1787582962.862374:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+9:14430:x1874416162164480:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582962.862407:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582962.862426:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539144 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5847f expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.862490:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753914b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.862516:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753914b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.862918:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753914b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.862936:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539152 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.862944:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539152 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.862951:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539152 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582962.865126:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787582962.865259:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753914b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865270:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753914b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865277:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753914b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865300:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582962.865305:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753914b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865313:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753914b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865350:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4b29100) 00010000:00010000:0.0:1787582962.865353:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582962.865357:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753914b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865364:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753914b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865380:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539152 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865386:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539152 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865392:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539152 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865398:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582962.865400:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539152 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865407:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539152 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865426:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8da5a0b68700) 00010000:00010000:0.0:1787582962.865429:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582962.865432:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539152 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865438:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539152 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865485:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539144 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5847f expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865495:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4b29100) 00010000:00010000:0.0:1787582962.865498:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787582962.865501:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539144 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5847f expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582962.865511:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147e800, rc 0) 00000100:00100000:0.0:1787582962.867217:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+10:14430:x1874416162164480:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 4835us (5042us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787582962.867228:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 25 00000100:00100000:2.0:1787582962.874273:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582962.874564:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162164608 00000100:00100000:1.0:1787582962.874574:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162164608 00000100:00100000:1.0:1787582962.874630:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 26 00000100:00100000:1.0:1787582962.874640:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+10:14430:x1874416162164608:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:1.0:1787582962.874661:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582962.874681:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b7539160 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58486 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.874762:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87e00/0xa113d808b7539167 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.874775:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87e00/0xa113d808b7539167 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.877751:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87e00/0xa113d808b7539167 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582962.878126:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787582962.878131:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582962.878153:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87e00/0xa113d808b7539167 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.878211:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b7539160 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58486 expref: 12 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.878230:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87e00/0xa113d808b7539167 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58486 expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582962.878240:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8da5a4b29000) 00010000:00010000:1.0:1787582962.878243:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787582962.878247:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d87e00, rc 0) 00000100:00100000:1.0:1787582962.878705:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+11:14430:x1874416162164608:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 4064us (4445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582962.878714:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 26 00000100:00100000:2.0:1787582962.890084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582962.890226:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162164736 00000100:00100000:3.0:1787582962.890235:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162164736 00000100:00100000:3.0:1787582962.890375:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 3 00000100:00100000:3.0:1787582962.890387:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+11:14430:x1874416162164736:12345-192.168.206.20@tcp:37:lfs.0 00000100:00100000:0.0:1787582962.899985:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+11:14430:x1874416162164736:12345-192.168.206.20@tcp:37:lfs.0 Request processed in 9582us (9891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582962.899998:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 3 00000100:00100000:2.0:1787582962.908662:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582962.909996:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162164992 00000100:00100000:0.0:1787582962.910015:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162164992 00000100:00100000:0.0:1787582962.910082:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 4 00000100:00100000:0.0:1787582962.910093:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589260450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+11:14430:x1874416162164992:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:0.0:1787582962.910367:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589260450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+12:14430:x1874416162164992:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 275us (1714us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787582962.910376:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 4 00000100:00100000:2.0:1787582963.011430:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582963.011531:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162165120 00000100:00100000:0.0:1787582963.011541:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162165120 00000100:00100000:0.0:1787582963.011594:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 27 00000100:00100000:0.0:1787582963.011603:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+10:14436:x1874416162165120:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:0.0:1787582963.011621:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582963.011638:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b753916e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5848d expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.011695:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539175 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.011707:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539175 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.011718:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539175 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.011732:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753917c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.011738:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753917c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.011744:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753917c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.011850:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b7539183 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.011869:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b7539183 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.011875:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b7539183 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582963.011903:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787582963.011907:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582963.011946:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b7539183 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.011957:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539175 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.011964:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539175 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.011970:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539175 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.011976:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582963.011980:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539175 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.011987:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539175 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.012009:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4b29100) 00010000:00010000:0.0:1787582963.012012:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582963.012016:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539175 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.012029:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539175 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.012042:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753917c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.012058:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753917c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.012064:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753917c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.012069:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582963.012071:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753917c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.012076:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753917c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.012083:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8da5a0b68700) 00010000:00010000:0.0:1787582963.012085:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582963.012087:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753917c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.012092:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753917c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.012117:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b753916e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5848d expref: 12 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.012140:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147fa00/0xa113d808b7539183 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5848d expref: 11 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.012147:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8da5a4b29000) 00010000:00010000:0.0:1787582963.012149:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787582963.012151:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147fa00, rc 0) 00000100:00100000:0.0:1787582963.012405:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+11:14436:x1874416162165120:12345-192.168.206.20@tcp:101:bash.0 Request processed in 800us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582963.012413:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 27 00000100:00100000:3.0:1787582963.018494:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582963.018622:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162165376 00000100:00100000:1.0:1787582963.018631:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162165376 00000100:00100000:1.0:1787582963.018688:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 28 00000100:00100000:1.0:1787582963.018699:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+11:14436:x1874416162165376:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:1.0:1787582963.018717:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582963.018733:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b753918a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58494 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.018851:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b7539191 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.018866:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87e00/0xa113d808b7539167 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58486 expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.018875:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b7539191 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.018918:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87e00/0xa113d808b7539167 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58486 expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.018931:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87e00/0xa113d808b7539167 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58486 expref: 11 pid: 14329 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582963.018945:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874416186272128:192.168.206.20@tcp:104: 00000100:00100000:1.0:1787582963.019049:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da585334e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582963.031451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582963.031557:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162165504 00000100:00100000:0.0:1787582963.031567:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162165504 00010000:00010000:0.0:1787582963.031606:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87e00/0xa113d808b7539167 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58486 expref: 12 pid: 14329 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582963.031646:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00100000:0.0:1787582963.031656:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb681500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+12:2359:x1874416162165504:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787582963.031669:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787582963.031676:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87e00/0xa113d808b7539167 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58486 expref: 12 pid: 14329 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.031690:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87e00/0xa113d808b7539167 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58486 expref: 12 pid: 14329 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.031712:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8da5a4b29000) 00010000:00010000:0.0:1787582963.031717:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b7539191 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.031732:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b7539191 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.031740:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b7539191 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.031757:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787582963.031807:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb681500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+12:2359:x1874416162165504:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 152us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582963.031815:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 10 00010000:00010000:1.0:1787582963.035383:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87e00/0xa113d808b7539167 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58486 expref: 11 pid: 14329 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582963.035408:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874416186272128:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582963.035429:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b7539191 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.035439:0:14329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b7539191 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.035445:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b7539191 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.035470:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86e00/0xa113d808b7539198 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.035481:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86e00/0xa113d808b7539198 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.035491:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86e00/0xa113d808b7539198 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.037489:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87800/0xa113d808b753919f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.037509:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87800/0xa113d808b753919f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.037520:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87800/0xa113d808b753919f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582963.037544:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787582963.037573:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b7539191 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.037580:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b7539191 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.037587:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b7539191 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.037593:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d87a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582963.037597:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b7539191 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.037604:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b7539191 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.037616:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8da5a4b29000) 00010000:00010000:1.0:1787582963.037619:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582963.037623:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b7539191 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.037643:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b7539191 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787582963.037656:0:14329:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006514cd9c reply state 00000000e8ffc2f7 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86e00/0xa113d808b7539198 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582963.037664:0:14329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787582963.037700:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b753918a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58494 expref: 14 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.037714:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87800/0xa113d808b753919f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58494 expref: 13 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.037721:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:1.0:1787582963.037723:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787582963.037725:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d87800, rc 0) 00000100:00100000:1.0:1787582963.037805:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+14:14436:x1874416162165376:12345-192.168.206.20@tcp:101:bash.0 Request processed in 19107us (19319us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787582963.037814:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 28 00010000:00010000:0.0:1787582963.040628:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86e00/0xa113d808b7539198 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.040646:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86e00/0xa113d808b7539198 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.040653:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86e00/0xa113d808b7539198 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.040659:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d86e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582963.040663:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86e00/0xa113d808b7539198 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.040670:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86e00/0xa113d808b7539198 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.040687:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8da5a4b29800) 00010000:00010000:0.0:1787582963.040690:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582963.040695:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86e00/0xa113d808b7539198 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.040718:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86e00/0xa113d808b7539198 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582963.059725:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582963.059824:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162165632 00000100:00100000:1.0:1787582963.059834:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162165632 00000100:00100000:1.0:1787582963.059965:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 29 00000100:00100000:1.0:1787582963.059975:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+13:14436:x1874416162165632:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:1.0:1787582963.059997:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582963.060016:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5849b expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.060094:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b75391b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.060106:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b75391b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.060116:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b75391b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582963.060150:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787582963.060154:0:14331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582963.060170:0:14331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b75391b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.060180:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b75391b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.060202:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5849b expref: 15 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.060217:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b75391b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5849b expref: 14 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.060225:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:1.0:1787582963.060229:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582963.060232:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d87a00, rc 0) 00000100:00100000:1.0:1787582963.061642:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+14:14436:x1874416162165632:12345-192.168.206.20@tcp:101:bash.0 Request processed in 1660us (1918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582963.061654:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 29 00000100:00100000:3.0:1787582963.066114:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582963.066197:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162165888 00000100:00100000:0.0:1787582963.066206:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162165888 00000100:00100000:0.0:1787582963.066259:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 5 00000100:00100000:0.0:1787582963.066270:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+14:14436:x1874416162165888:12345-192.168.206.20@tcp:35:bash.0 00000100:00100000:0.0:1787582963.066610:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+15:14436:x1874416162165888:12345-192.168.206.20@tcp:35:bash.0 Request processed in 341us (505us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787582963.066618:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 5 00000100:00100000:3.0:1787582963.189120:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582963.189246:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162166144 00000100:00100000:1.0:1787582963.189256:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162166144 00000100:00100000:1.0:1787582963.189365:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 30 00000100:00100000:1.0:1787582963.189376:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+15:14446:x1874416162166144:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:1.0:1787582963.189398:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582963.189418:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d584a2 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582963.189800:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787582963.189911:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584a2 expref: 17 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.189925:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4b29100) 00010000:00010000:1.0:1787582963.189928:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787582963.189933:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584a2 expref: 17 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.189946:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d87200, rc 0) 00000100:00100000:1.0:1787582963.190097:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+16:14446:x1874416162166144:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 722us (985us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787582963.190105:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 30 00000100:00100000:3.0:1787582963.194561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582963.194827:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162166400 00000100:00100000:0.0:1787582963.194837:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162166400 00000100:00100000:0.0:1787582963.194924:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 6 00000100:00100000:0.0:1787582963.194935:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+16:14446:x1874416162166400:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:0.0:1787582963.195165:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+17:14446:x1874416162166400:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 232us (613us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1787582963.195173:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 6 00000100:00100000:1.0:1787582963.245034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582963.245125:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162166656 00000100:00100000:0.0:1787582963.245134:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162166656 00000100:00100000:0.0:1787582963.245191:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 31 00000100:00100000:0.0:1787582963.245210:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+17:14449:x1874416162166656:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:0.0:1787582963.245232:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582963.245250:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b75391c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d584a9 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.245503:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75391d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.245517:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75391d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.245542:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75391d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582963.245554:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787582963.245674:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b75391c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584a9 expref: 20 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.245692:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75391d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584a9 expref: 19 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.245700:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:0.0:1787582963.245703:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582963.245706:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147e600, rc 0) 00000100:00100000:0.0:1787582963.245804:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+19:14449:x1874416162166656:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 603us (775us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787582963.245811:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 31 00000100:00100000:3.0:1787582963.252121:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582963.252162:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582963.252286:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162166784 00000100:00100000:1.0:1787582963.252295:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162166784 00000100:00100000:1.0:1787582963.252371:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 32 00000100:00100000:1.0:1787582963.252380:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+19:14449:x1874416162166784:12345-192.168.206.20@tcp:54:lfs.0 00010000:00010000:1.0:1787582963.252437:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.252465:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.252476:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.252504:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.252511:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391de lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.252518:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.252542:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d87200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582963.252546:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.252554:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391de lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.252566:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:1.0:1787582963.252569:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787582963.252574:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391de lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.252579:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582963.252637:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+19:14449:x1874416162166784:12345-192.168.206.20@tcp:54:lfs.0 Request processed in 258us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582963.252650:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 32 00000100:00100000:2.0:1787582963.252927:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162166912 00000100:00100000:2.0:1787582963.252932:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162166912 00000100:00100000:2.0:1787582963.252968:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 0 00000100:00100000:2.0:1787582963.252975:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+19:2358:x1874416162166912:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582963.252985:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582963.252998:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75391d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584a9 expref: 19 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582963.253010:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:2.0:1787582963.253013:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582963.253071:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+18:2358:x1874416162166912:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 96us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582963.253077:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 0 00000100:00100000:3.0:1787582963.258014:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582963.258157:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162167168 00000100:00100000:2.0:1787582963.258166:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162167168 00000100:00100000:2.0:1787582963.258215:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 7 00000100:00100000:2.0:1787582963.258225:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+18:14449:x1874416162167168:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:2.0:1787582963.258449:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+19:14449:x1874416162167168:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 225us (441us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787582963.258456:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 7 00010000:00010000:3.0:1787582963.408777:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787582963.658021:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582963.658620:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162167424 00000100:00100000:1.0:1787582963.658632:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162167424 00000100:00100000:1.0:1787582963.658754:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 33 00000100:00100000:1.0:1787582963.658790:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+19:14480:x1874416162167424:12345-192.168.206.20@tcp:101:cat.0 00010000:00010000:1.0:1787582963.658813:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582963.659396:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d584b0 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.659495:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86200/0xa113d808b75391ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.659533:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86200/0xa113d808b75391ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.659546:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86200/0xa113d808b75391ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582963.659559:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787582963.659702:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87200/0xa113d808b75391e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584b0 expref: 22 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.659722:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86200/0xa113d808b75391ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584b0 expref: 21 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582963.659731:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:1.0:1787582963.659734:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582963.659738:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d86200, rc 0) 00000100:00100000:1.0:1787582963.659983:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+21:14480:x1874416162167424:12345-192.168.206.20@tcp:101:cat.0 Request processed in 1194us (1968us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787582963.659991:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 33 00000100:00100000:2.0:1787582963.663791:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582963.668403:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162167680 00000100:00100000:3.0:1787582963.668420:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162167680 00000100:00100000:3.0:1787582963.668502:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 8 00000100:00100000:3.0:1787582963.668513:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+21:14480:x1874416162167680:12345-192.168.206.20@tcp:35:cat.0 00000100:00100000:3.0:1787582963.669099:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+22:14480:x1874416162167680:12345-192.168.206.20@tcp:35:cat.0 Request processed in 586us (5320us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787582963.669108:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 8 00000100:00100000:2.0:1787582963.670436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582963.670572:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162167808 00000100:00100000:3.0:1787582963.670580:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162167808 00000100:00100000:3.0:1787582963.670632:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 1 00000100:00100000:3.0:1787582963.670642:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+22:2357:x1874416162167808:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582963.670666:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582963.670690:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86200/0xa113d808b75391ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584b0 expref: 22 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582963.670708:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:3.0:1787582963.670713:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582963.678463:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+21:2357:x1874416162167808:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 7810us (8021us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582963.678479:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 1 00000100:00100000:2.0:1787582963.774134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582963.774455:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162168064 00000100:00100000:0.0:1787582963.774465:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162168064 00000100:00100000:0.0:1787582963.774534:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 34 00000100:00100000:0.0:1787582963.774544:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+21:14486:x1874416162168064:12345-192.168.206.20@tcp:101:dd.0 00010000:00010000:0.0:1787582963.774580:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582963.774600:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b75391fa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d584b7 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.774691:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539201 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.774705:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539201 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.774716:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539201 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582963.774727:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787582963.775416:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b75391fa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584b7 expref: 24 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.775448:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539201 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584b7 expref: 23 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.775457:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:0.0:1787582963.775460:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582963.775464:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147ec00, rc 0) 00000100:00100000:0.0:1787582963.775514:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+23:14486:x1874416162168064:12345-192.168.206.20@tcp:101:dd.0 Request processed in 971us (1390us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787582963.775534:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 34 00000100:00100000:0.0:1787582963.782724:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582963.782836:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162168320 00000100:00100000:2.0:1787582963.782846:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162168320 00000100:00100000:2.0:1787582963.782909:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 35 00000100:00100000:2.0:1787582963.782920:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+23:14486:x1874416162168320:12345-192.168.206.20@tcp:36:dd.0 00010000:00010000:2.0:1787582963.782985:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787582963.783012:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539201 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584b7 expref: 23 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582963.783038:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87a00/0xa113d808b75391b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5849b expref: 22 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582963.783051:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:2.0:1787582963.783056:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787582963.783249:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b753920f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582963.783263:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b753920f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582963.783271:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b753920f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787582963.783401:0:14330:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787582963.783441:0:14330:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e2b5609 reply state 00000000b024c59c transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b753920f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582963.783450:0:14330:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787582963.783551:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+24:14486:x1874416162168320:12345-192.168.206.20@tcp:36:dd.0 Request processed in 632us (837us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787582963.783558:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 35 00000020:00080000:2.0:1787582963.783563:0:14330:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787582963.786992:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b753920f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.787024:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b753920f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.787032:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b753920f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.787037:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9fc00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582963.787041:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b753920f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.787047:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b753920f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.787064:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:0.0:1787582963.787067:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582963.787072:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b753920f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582963.787078:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b753920f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582963.892974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582963.893092:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162168576 00000100:00100000:3.0:1787582963.893102:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162168576 00000100:00100000:3.0:1787582963.893223:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:3.0:1787582963.893234:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+23:14486:x1874416162168576:12345-192.168.206.20@tcp:35:dd.0 00000100:00100000:3.0:1787582963.893570:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+24:14486:x1874416162168576:12345-192.168.206.20@tcp:35:dd.0 Request processed in 337us (604us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1787582963.893579:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 9 00000100:00100000:1.0:1787582964.208764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582964.208864:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162168704 00000100:00100000:0.0:1787582964.208874:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162168704 00000100:00100000:0.0:1787582964.208948:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 36 00000100:00100000:0.0:1787582964.208959:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+24:14500:x1874416162168704:12345-192.168.206.20@tcp:101:stat.0 00010000:00010000:0.0:1787582964.208981:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582964.209001:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b7539216 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d584be expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209096:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b753921d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209111:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b753921d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209124:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b753921d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209139:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539224 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209147:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539224 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209154:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539224 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209242:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b753922b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209250:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b753922b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209257:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b753922b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582964.209301:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787582964.209305:0:14331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582964.209366:0:14331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b753922b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209389:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b753922b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209397:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b753921d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209404:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b753921d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209411:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b753921d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209417:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582964.209421:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b753921d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209429:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b753921d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209440:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8da5a4b29000) 00010000:00010000:0.0:1787582964.209443:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582964.209447:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b753921d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209452:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b753921d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209464:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539224 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209469:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539224 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209481:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539224 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209486:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147ec00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582964.209489:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539224 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209494:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539224 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209502:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8da5a0b68700) 00010000:00010000:0.0:1787582964.209504:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582964.209507:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539224 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209513:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539224 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209554:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b7539216 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584be expref: 26 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209567:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b753922b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584be expref: 25 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.209575:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:0.0:1787582964.209577:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582964.209585:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147e800, rc 0) 00000100:00080000:2.0:1787582964.209724:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582964.210121:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+25:14500:x1874416162168704:12345-192.168.206.20@tcp:101:stat.0 Request processed in 1162us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582964.210138:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 36 00000100:00100000:2.0:1787582964.292697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582964.292957:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162168960 00000100:00100000:1.0:1787582964.292968:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162168960 00000100:00100000:1.0:1787582964.293155:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 37 00000100:00100000:1.0:1787582964.293168:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+25:14506:x1874416162168960:12345-192.168.206.20@tcp:36:truncate.0 00010000:00010000:1.0:1787582964.293220:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582964.293246:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b753922b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584be expref: 25 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.293276:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:1.0:1787582964.293281:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787582964.294672:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86c00/0xa113d808b7539232 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.294691:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86c00/0xa113d808b7539232 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.294701:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86c00/0xa113d808b7539232 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787582964.294752:0:14330:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1787582964.294875:0:14330:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f49d5546 reply state 0000000057634c49 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86c00/0xa113d808b7539232 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582964.294885:0:14330:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787582964.295005:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+27:14506:x1874416162168960:12345-192.168.206.20@tcp:36:truncate.0 Request processed in 1838us (2314us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787582964.295253:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 37 00000020:00080000:1.0:1787582964.295269:0:14330:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787582964.307229:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86c00/0xa113d808b7539232 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.307248:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86c00/0xa113d808b7539232 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.307256:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86c00/0xa113d808b7539232 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.307463:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d86c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582964.307469:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86c00/0xa113d808b7539232 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.307477:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86c00/0xa113d808b7539232 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.307577:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:1.0:1787582964.307581:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582964.307586:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86c00/0xa113d808b7539232 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.307592:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86c00/0xa113d808b7539232 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.432750:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787582964.521723:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582964.521938:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162169088 00000100:00100000:0.0:1787582964.521949:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162169088 00000100:00100000:0.0:1787582964.522015:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 38 00000100:00100000:0.0:1787582964.522026:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+26:14520:x1874416162169088:12345-192.168.206.20@tcp:101:stat.0 00010000:00010000:0.0:1787582964.522050:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582964.522071:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b7539239 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d584c5 expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522139:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539240 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522151:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539240 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522162:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539240 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522176:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539247 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522182:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539247 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522189:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539247 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522283:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753924e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522302:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753924e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522310:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753924e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582964.522372:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1787582964.522376:0:14331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582964.522395:0:14331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753924e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522407:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753924e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522416:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539240 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522421:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539240 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522428:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539240 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522433:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147ec00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582964.522437:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539240 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522445:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539240 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522457:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8da5a4b29000) 00010000:00010000:0.0:1787582964.522466:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582964.522472:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539240 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522478:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539240 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522493:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539247 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522499:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539247 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522504:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539247 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522509:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582964.522512:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539247 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522528:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539247 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522536:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8da5a0b68700) 00010000:00010000:0.0:1787582964.522539:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582964.522541:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539247 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522547:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b7539247 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522576:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b7539239 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584c5 expref: 28 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522600:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753924e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584c5 expref: 27 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.522607:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:0.0:1787582964.522610:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787582964.522612:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147e600, rc 0) 00000100:00100000:0.0:1787582964.522682:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+27:14520:x1874416162169088:12345-192.168.206.20@tcp:101:stat.0 Request processed in 657us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582964.522689:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 38 00000100:00100000:0.0:1787582964.637415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582964.637507:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162169344 00000100:00100000:1.0:1787582964.637526:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162169344 00000100:00100000:1.0:1787582964.637587:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 39 00000100:00100000:1.0:1787582964.637599:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+27:14530:x1874416162169344:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:1.0:1787582964.637652:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582964.637674:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86c00/0xa113d808b7539255 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d584cc expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582964.637964:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787582964.638080:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86c00/0xa113d808b7539255 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584cc expref: 29 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.638095:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4b29100) 00010000:00010000:1.0:1787582964.638098:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787582964.638104:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86c00/0xa113d808b7539255 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584cc expref: 29 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.638118:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d86c00, rc 0) 00000100:00100000:1.0:1787582964.638178:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+28:14530:x1874416162169344:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 581us (772us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1787582964.638185:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 39 00000100:00100000:2.0:1787582964.644041:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582964.644136:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162169600 00000100:00100000:3.0:1787582964.644147:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162169600 00000100:00100000:3.0:1787582964.644211:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00100000:3.0:1787582964.644222:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da589261850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+28:14530:x1874416162169600:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:3.0:1787582964.644505:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da589261850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+29:14530:x1874416162169600:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 283us (473us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1787582964.644523:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 10 00000100:00100000:2.0:1787582964.728899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582964.728981:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162169856 00000100:00100000:3.0:1787582964.729001:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162169856 00000100:00100000:3.0:1787582964.729061:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 40 00000100:00100000:3.0:1787582964.729072:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+29:14536:x1874416162169856:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:3.0:1787582964.729098:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582964.729118:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7539263 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d584d3 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.729227:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.729241:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87800/0xa113d808b753919f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58494 expref: 30 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.729250:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753924e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584c5 expref: 30 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.729258:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.729302:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753924e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584c5 expref: 30 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.729337:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753924e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584c5 expref: 30 pid: 14331 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582964.729353:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb2b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874416186272256:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582964.729464:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87800/0xa113d808b753919f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58494 expref: 30 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.729500:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87800/0xa113d808b753919f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58494 expref: 30 pid: 14329 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582964.729521:0:14329:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb2b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874416186272384:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582964.729559:0:14329:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58921d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787582964.732112:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb2b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874416186272256:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582964.743009:0:14329:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb2b2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14329:1874416186272384:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582964.743044:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582964.743418:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582964.743466:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582964.743563:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162169984 00000100:00100000:0.0:1787582964.743570:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162169984 00000100:00100000:3.0:1787582964.743592:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162170112 00000100:00100000:3.0:1787582964.743596:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162170112 00010000:00010000:0.0:1787582964.743607:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753924e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584c5 expref: 32 pid: 14331 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.743609:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87800/0xa113d808b753919f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58494 expref: 32 pid: 14329 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582964.752410:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00100000:3.0:1787582964.752441:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5ad719050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+32:2359:x1874416162169984:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582964.752466:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582964.752478:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753924e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584c5 expref: 32 pid: 14331 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.752521:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753924e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584c5 expref: 32 pid: 14331 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.752546:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b753924e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584c5 expref: 32 pid: 14331 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.752578:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:3.0:1787582964.752583:0:14316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.752592:0:14316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.752598:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582964.752663:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5ad719050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+31:2359:x1874416162169984:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 239us (9245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582964.752672:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00100000:3.0:1787582964.752728:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:3.0:1787582964.752735:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+30:2360:x1874416162170112:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582964.752743:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582964.752749:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87800/0xa113d808b753919f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58494 expref: 30 pid: 14329 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.752759:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87800/0xa113d808b753919f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58494 expref: 30 pid: 14329 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.752772:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87800/0xa113d808b753919f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58494 expref: 30 pid: 14329 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.752781:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:3.0:1787582964.752785:0:14316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.752803:0:14316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.752809:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.752833:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582964.752854:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+29:2360:x1874416162170112:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 118us (9386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582964.752861:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 12 00010000:00010000:3.0:1787582964.752890:0:14329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.752897:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582964.752914:0:14329:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1787582964.753055:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7539263 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584d3 expref: 30 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.753070:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584d3 expref: 29 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.753077:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:3.0:1787582964.753080:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787582964.753083:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0400, rc 0) 00000100:00100000:3.0:1787582964.753107:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+29:14536:x1874416162169856:12345-192.168.206.20@tcp:101:bash.0 Request processed in 24038us (24218us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1787582964.753126:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 40 00000100:00100000:3.0:1787582964.762259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582964.762570:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162170368 00000100:00100000:0.0:1787582964.762580:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162170368 00000100:00100000:0.0:1787582964.762637:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 41 00000100:00100000:0.0:1787582964.762647:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+29:14536:x1874416162170368:12345-192.168.206.20@tcp:36:bash.0 00010000:00010000:0.0:1787582964.762924:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b7539278 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.762940:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b7539278 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.762951:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b7539278 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787582964.763016:0:14331:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1787582964.763043:0:14331:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d23b70a5 reply state 00000000b85afb14 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b7539278 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582964.763052:0:14331:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787582964.763142:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+32:14536:x1874416162170368:12345-192.168.206.20@tcp:36:bash.0 Request processed in 496us (892us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1787582964.763149:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 41 00000020:00080000:0.0:1787582964.763154:0:14331:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787582964.767300:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b7539278 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.767332:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b7539278 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.767341:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b7539278 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.767348:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582964.767352:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b7539278 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.767359:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b7539278 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.767375:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:0.0:1787582964.767378:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582964.767383:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b7539278 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.767389:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b7539278 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582964.769948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582964.771617:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162170496 00000100:00100000:0.0:1787582964.771641:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162170496 00000100:00100000:0.0:1787582964.771712:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 42 00000100:00100000:0.0:1787582964.771723:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+31:14536:x1874416162170496:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:0.0:1787582964.771747:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582964.771765:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b753927f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d584da expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.772036:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b753927f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584da expref: 32 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.772051:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b753927f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584da expref: 32 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.772071:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:0.0:1787582964.772075:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787582964.772079:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147e200, rc 0) 00000100:00100000:0.0:1787582964.772144:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+32:14536:x1874416162170496:12345-192.168.206.20@tcp:101:bash.0 Request processed in 422us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582964.772152:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 42 00000100:00100000:3.0:1787582964.777218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582964.777351:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162170624 00000100:00100000:1.0:1787582964.777361:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162170624 00000100:00100000:1.0:1787582964.777423:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 43 00000100:00100000:1.0:1787582964.777434:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+32:14536:x1874416162170624:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:1.0:1787582964.777453:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582964.777472:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87000/0xa113d808b7539286 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d584e1 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.777576:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86800/0xa113d808b753928d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.777605:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584d3 expref: 33 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.777615:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86800/0xa113d808b753928d lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.777648:0:14330:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584d3 expref: 33 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.777661:0:14330:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584d3 expref: 33 pid: 14329 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582964.777674:0:14330:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14330:1874416186272512:192.168.206.20@tcp:104: 00000100:00100000:1.0:1787582964.777935:0:14330:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a0640240 going to sleep for 11 seconds 00000100:00100000:2.0:1787582964.782119:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582964.782727:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162170752 00000100:00100000:3.0:1787582964.782738:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162170752 00010000:00010000:3.0:1787582964.782858:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584d3 expref: 34 pid: 14329 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582964.782902:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:3.0:1787582964.782911:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+34:2360:x1874416162170752:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582964.782925:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582964.782931:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584d3 expref: 34 pid: 14329 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.782945:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584d3 expref: 34 pid: 14329 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.782966:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:3.0:1787582964.782971:0:14316:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86800/0xa113d808b753928d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.782980:0:14316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86800/0xa113d808b753928d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.782988:0:14316:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86800/0xa113d808b753928d lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.783022:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582964.783125:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+34:2360:x1874416162170752:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 214us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582964.783133:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 13 00010000:00010000:1.0:1787582964.783394:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0400/0xa113d808b753926a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584d3 expref: 33 pid: 14329 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582964.783412:0:14330:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14330:1874416186272512:192.168.206.20@tcp:104: 00010000:00010000:1.0:1787582964.783435:0:14330:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86800/0xa113d808b753928d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.783444:0:14330:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86800/0xa113d808b753928d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.783450:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86800/0xa113d808b753928d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582964.783521:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787582964.783651:0:14330:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787582964.783675:0:14330:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86800/0xa113d808b753928d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.783706:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87000/0xa113d808b7539286 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584e1 expref: 33 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.783718:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86800/0xa113d808b753928d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584e1 expref: 32 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.783725:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:1.0:1787582964.783728:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787582964.783730:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d86800, rc 0) 00000100:00100000:1.0:1787582964.783827:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+32:14536:x1874416162170624:12345-192.168.206.20@tcp:101:bash.0 Request processed in 6395us (6617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582964.783835:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 43 00000100:00100000:2.0:1787582964.790875:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582964.791010:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162171008 00000100:00100000:3.0:1787582964.791019:0:14314:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162171008 00000100:00100000:3.0:1787582964.791186:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 2 00000100:00100000:3.0:1787582964.791198:0:14314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+32:14536:x1874416162171008:12345-192.168.206.20@tcp:103:bash.0 00010000:00010000:3.0:1787582964.791212:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787582964.791235:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86800/0xa113d808b753928d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584e1 expref: 32 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.791255:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e200/0xa113d808b753927f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584da expref: 31 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.791275:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da5a4b29500) 00010000:00010000:3.0:1787582964.791285:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582964.791358:0:14314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+30:14536:x1874416162171008:12345-192.168.206.20@tcp:103:bash.0 Request processed in 162us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582964.791365:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 2 00000100:00100000:0.0:1787582964.794917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582964.795040:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162171136 00000100:00100000:3.0:1787582964.795049:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162171136 00000100:00100000:3.0:1787582964.795248:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 44 00000100:00100000:3.0:1787582964.795259:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+30:14536:x1874416162171136:12345-192.168.206.20@tcp:58:bash.0 00010000:00010000:3.0:1787582964.795389:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7539294 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.795418:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7539294 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.795430:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7539294 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787582964.796607:0:14329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787582964.796837:0:14329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787582964.796912:0:14329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1787582964.797014:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+30:14536:x1874416162171136:12345-192.168.206.20@tcp:58:bash.0 Request processed in 1754us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582964.797023:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 44 00000100:00100000:2.0:1787582964.802279:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582964.802493:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162171264 00000100:00100000:1.0:1787582964.802503:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162171264 00000100:00100000:1.0:1787582964.802563:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 45 00000100:00100000:1.0:1787582964.802572:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5adbf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+30:14536:x1874416162171264:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:1.0:1787582964.802589:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582964.802608:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87000/0xa113d808b753929b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d584e8 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.802658:0:14330:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7539294 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.802668:0:14330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87000/0xa113d808b753929b lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584e8 expref: 31 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.802703:0:14330:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7539294 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.802715:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87000/0xa113d808b753929b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584e8 expref: 31 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.802727:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da583acc500) 00010000:00010000:1.0:1787582964.802730:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787582964.802733:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87000/0xa113d808b753929b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584e8 expref: 31 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.802740:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d87000, rc 0) 00000100:00100000:1.0:1787582964.802805:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5adbf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+31:14536:x1874416162171264:12345-192.168.206.20@tcp:101:bash.0 Request processed in 233us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582964.802812:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 45 00000040:00080000:3.0:1787582964.881818:0:14362:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787582964.881826:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787582964.881858:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787582964.881864:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787582964.881966:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb2b2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14362:1874416186272640:192.168.206.20@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787582964.882057:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da588477180 going to sleep for 11 seconds 00000100:00100000:2.0:1787582964.890413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582964.890531:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb2b2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14362:1874416186272640:192.168.206.20@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787582964.890834:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162171392 00000100:00100000:0.0:1787582964.890842:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162171392 00000100:00100000:0.0:1787582964.890895:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 0 00000100:00100000:0.0:1787582964.890905:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+31:14537:x1874416162171392:12345-192.168.206.20@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787582964.890986:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+31:14537:x1874416162171392:12345-192.168.206.20@tcp:900:lhsmtool_posix.0 Request processed in 82us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582964.891006:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 0 00000100:00100000:0.0:1787582964.896107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582964.896188:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162171520 00000100:00100000:3.0:1787582964.896199:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162171520 00000100:00100000:3.0:1787582964.896257:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 46 00000100:00100000:3.0:1787582964.896268:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+31:14537:x1874416162171520:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787582964.896299:0:14329:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787582964.896435:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+31:14537:x1874416162171520:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 Request processed in 168us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582964.896459:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 46 00000100:00100000:2.0:1787582964.899979:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582964.900178:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162171648 00000100:00100000:0.0:1787582964.900188:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162171648 00000100:00100000:0.0:1787582964.900247:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 47 00000100:00100000:0.0:1787582964.900256:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+31:14537:x1874416162171648:12345-192.168.206.20@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787582964.900506:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75392a2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900536:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75392a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900548:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75392a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900565:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b75392a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900572:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b75392a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900578:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b75392a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900599:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b75392b0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900608:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b75392b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900613:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b75392b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787582964.900663:0:14331:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787582964.900667:0:14331:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787582964.900680:0:14331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b75392b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900690:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75392a2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900696:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75392a2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900702:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75392a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900707:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582964.900712:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75392a2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900718:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75392a2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900730:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8da5a0b68200) 00010000:00010000:0.0:1787582964.900733:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582964.900750:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75392a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900757:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e600/0xa113d808b75392a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900770:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b75392a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900786:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b75392a9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900792:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b75392a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900797:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582964.900800:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b75392a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900806:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b75392a9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900814:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8da5a0b68900) 00010000:00010000:0.0:1787582964.900816:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582964.900818:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b75392a9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900824:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b75392a9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900838:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b75392b0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900844:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b75392b0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900849:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b75392b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900854:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582964.900862:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b75392b0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900868:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b75392b0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900877:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da583acc500) 00010000:00010000:0.0:1787582964.900879:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582964.900882:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b75392b0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.900888:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b75392b0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582964.901379:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+31:14537:x1874416162171648:12345-192.168.206.20@tcp:34:lhsmtool_posix.0 Request processed in 1119us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582964.901389:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 47 00000100:00100000:0.0:1787582964.916689:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582964.916786:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162171904 00000100:00100000:1.0:1787582964.916795:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162171904 00000100:00100000:1.0:1787582964.916850:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 48 00000100:00100000:1.0:1787582964.916859:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+31:14537:x1874416162171904:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787582964.916879:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787582964.916899:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87c00/0xa113d808b75392b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d584ef expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.916999:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86600/0xa113d808b75392be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.917013:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86600/0xa113d808b75392be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.917038:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86600/0xa113d808b75392be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787582964.917050:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787582964.917176:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86600/0xa113d808b75392be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.917183:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86600/0xa113d808b75392be lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.917204:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86600/0xa113d808b75392be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.917210:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d86600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582964.917214:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86600/0xa113d808b75392be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.917220:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86600/0xa113d808b75392be lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.917232:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da583acc500) 00010000:00010000:1.0:1787582964.917235:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787582964.917239:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86600/0xa113d808b75392be lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.917244:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86600/0xa113d808b75392be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.917283:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87c00/0xa113d808b75392b7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584ef expref: 33 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.917304:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8da5a0b68200) 00010000:00010000:1.0:1787582964.917306:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787582964.917310:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87c00/0xa113d808b75392b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584ef expref: 33 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.917375:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d87c00, rc 0) 00000100:00100000:1.0:1787582964.917432:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+32:14537:x1874416162171904:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 573us (751us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1787582964.917439:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 48 00000100:00100000:2.0:1787582964.921597:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582964.921750:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162172032 00000100:00100000:0.0:1787582964.921759:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162172032 00000100:00100000:0.0:1787582964.921814:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 49 00000100:00100000:0.0:1787582964.921824:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+32:14537:x1874416162172032:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787582964.921857:0:14331:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787582964.921950:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+32:14537:x1874416162172032:12345-192.168.206.20@tcp:53:lhsmtool_posix.0 Request processed in 127us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582964.921958:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 49 00000100:00100000:1.0:1787582964.925443:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582964.925597:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162172288 00000100:00100000:3.0:1787582964.925608:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162172288 00000100:00100000:3.0:1787582964.925662:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 50 00000100:00100000:3.0:1787582964.925671:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+32:14537:x1874416162172288:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787582964.925691:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582964.925710:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75392cc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d584f6 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787582964.926555:0:14329:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:3.0:1787582964.926564:0:14329:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1787582964.926616:0:14329:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1787582964.927036:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75392d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.927052:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75392d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.927063:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75392d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.927130:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b75392cc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584f6 expref: 35 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.927148:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75392d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584f6 expref: 34 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.927156:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8da583acc200) 00010000:00010000:3.0:1787582964.927166:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787582964.927169:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0000, rc 0) 00000100:00100000:3.0:1787582964.927235:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+34:14537:x1874416162172288:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 1564us (1801us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1787582964.927243:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 50 00000001:00080000:3.0:1787582964.934998:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000001:00080000:3.0:1787582964.935024:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1787582964.938636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582964.938751:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162172544 00000100:00100000:2.0:1787582964.938761:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162172544 00000100:00100000:2.0:1787582964.938849:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 51 00000100:00100000:2.0:1787582964.938859:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+13:14537:x1874416162172544:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787582964.938918:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582964.938943:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0000/0xa113d808b75392d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584f6 expref: 13 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.938960:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8da583acc200) 00010000:00010000:2.0:1787582964.938970:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787582964.938991:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75392e1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939006:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75392e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939016:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75392e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939046:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb85aed43 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939053:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb85aed43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939060:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb85aed43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939453:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75392e1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939461:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75392e1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939468:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75392e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939473:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9ec00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582964.939480:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75392e1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939487:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75392e1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939496:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8da5a4b29000) 00010000:00010000:2.0:1787582964.939499:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582964.939502:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75392e1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939508:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9ec00/0xa113d808b75392e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939536:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb85aed43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939542:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb85aed43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939548:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb85aed43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939553:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9fe00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787582964.939556:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb85aed43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939562:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb85aed43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939570:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb85aed43 (ffff8da5a4492a00) 00010000:00010000:2.0:1787582964.939573:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787582964.939576:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb85aed43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.939581:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb85aed43 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582964.939661:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+12:14537:x1874416162172544:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 Request processed in 803us (1033us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787582964.939669:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 51 00000100:00100000:3.0:1787582964.945524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582964.945719:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162172672 00000100:00100000:2.0:1787582964.945729:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162172672 00000100:00100000:2.0:1787582964.945784:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 52 00000100:00100000:2.0:1787582964.945809:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+12:14537:x1874416162172672:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787582964.945828:0:14331:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582964.945848:0:14331:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b75392ef lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d584fd expref: -99 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.945880:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75392f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.945893:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75392f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.945908:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75392f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.946000:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b75392ef lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584fd expref: 14 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.946019:0:14331:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e800/0xa113d808b75392f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584fd expref: 13 pid: 14331 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.946028:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8da5a4492d00) 00010000:00010000:2.0:1787582964.946031:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787582964.946034:0:14331:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9e800, rc 0) 00000100:00100000:2.0:1787582964.946140:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+13:14537:x1874416162172672:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 333us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582964.946148:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 52 00000100:00100000:0.0:1787582964.951723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582964.952368:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162172928 00000100:00100000:2.0:1787582964.952379:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162172928 00000100:00100000:2.0:1787582964.952429:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 53 00000100:00100000:2.0:1787582964.952451:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+13:14537:x1874416162172928:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787582964.952538:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392fd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.952554:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582964.952565:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787582964.953042:0:14330:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787582964.953054:0:14330:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 505959735360ns, next at 506959732665ns, rc = 0 00000004:00010000:2.0:1787582964.953137:0:14330:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fdb2468 reply state 000000009d626915 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582964.953147:0:14330:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787582964.953256:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+15:14537:x1874416162172928:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 Request processed in 806us (1542us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1787582964.953264:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 53 00010000:00010000:1.0:1787582964.955521:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392fd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.955537:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392fd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.955544:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.955550:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9fe00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582964.955555:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392fd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.955562:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392fd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.955578:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8da5a4492d00) 00010000:00010000:1.0:1787582964.955581:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787582964.955598:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392fd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582964.955605:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fe00/0xa113d808b75392fd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582964.956709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582964.956774:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162173056 00000100:00100000:3.0:1787582964.956784:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162173056 00000100:00100000:3.0:1787582964.956835:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 54 00000100:00100000:3.0:1787582964.956845:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+14:14537:x1874416162173056:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787582964.956866:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582964.956882:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7539304 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58504 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.956934:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7539304 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58504 expref: 15 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.956948:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7539304 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58504 expref: 15 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.956966:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8da5a4492d00) 00010000:00010000:3.0:1787582964.956969:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787582964.956972:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0200, rc 0) 00000100:00100000:3.0:1787582964.957025:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+15:14537:x1874416162173056:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 182us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582964.957045:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 54 00000100:00100000:2.0:1787582964.960777:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582964.960853:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162173184 00000100:00100000:3.0:1787582964.960863:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162173184 00000100:00100000:3.0:1787582964.960936:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:3.0:1787582964.960948:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+5:2360:x1874416162173184:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787582964.961277:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787582964.961435:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:2360:x1874416162173184:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 Request processed in 489us (666us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787582964.961444:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:2.0:1787582964.964162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582964.964243:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162173440 00000100:00100000:3.0:1787582964.964252:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162173440 00000100:00100000:3.0:1787582964.964309:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00100000:3.0:1787582964.964351:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+15:14537:x1874416162173440:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787582964.964581:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+16:14537:x1874416162173440:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 Request processed in 263us (427us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787582964.964588:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 11 00000100:00100000:1.0:1787582964.967550:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582964.967667:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162173696 00000100:00100000:0.0:1787582964.967686:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162173696 00000100:00100000:0.0:1787582964.967744:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 55 00000100:00100000:0.0:1787582964.967762:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+16:14537:x1874416162173696:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787582964.967865:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+16:14537:x1874416162173696:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 104us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582964.967871:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 55 00000100:00100000:2.0:1787582964.970423:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582964.970509:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162173824 00000100:00100000:3.0:1787582964.970541:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162173824 00000100:00100000:3.0:1787582964.970593:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 56 00000100:00100000:3.0:1787582964.970603:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+16:14537:x1874416162173824:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787582964.970619:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582964.970637:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b753930b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d5850b expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.970698:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7539312 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.970728:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7539312 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.970738:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7539312 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787582964.970783:0:14329:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787582964.970801:0:14329:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7539312 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.970825:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0800/0xa113d808b753930b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5850b expref: 18 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.970842:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7539312 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5850b expref: 17 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582964.970851:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8da5a4492d00) 00010000:00010000:3.0:1787582964.970854:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787582964.970857:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d1e00, rc 0) 00000100:00100000:3.0:1787582964.970909:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+17:14537:x1874416162173824:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 308us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582964.970916:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 56 00000100:00100000:3.0:1787582964.976046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582964.976250:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162173952 00000100:00100000:0.0:1787582964.976271:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162173952 00000100:00100000:0.0:1787582964.976368:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:0.0:1787582964.976379:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+6:2359:x1874416162173952:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787582964.976397:0:15014:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787582964.976417:0:15014:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012302236/0xa113d808b7539319 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58512 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787582964.976443:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c59f5, blocks: 0x1 00010000:00010000:0.0:1787582964.976463:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1787582964.976468:0:15014:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582964.976477:0:15014:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012302236/0xa113d808b7539319 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58512 expref: 7 pid: 15014 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.976669:0:15014:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012302236/0xa113d808b7539319 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58512 expref: 7 pid: 15014 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582964.976685:0:15014:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da58147ec00, rc 0) 00000100:00100000:0.0:1787582964.976791:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+7:2359:x1874416162173952:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 414us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582964.976814:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:1.0:1787582964.981056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582964.981158:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162174208 00000100:00100000:2.0:1787582964.981167:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162174208 00000100:00100000:2.0:1787582964.981263:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 57 00000100:00100000:2.0:1787582964.981274:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+17:14537:x1874416162174208:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787582964.981396:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+17:14537:x1874416162174208:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 125us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582964.981419:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 57 00000100:00100000:1.0:1787582964.984624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582964.984719:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162174336 00000100:00100000:0.0:1787582964.984727:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162174336 00000100:00100000:0.0:1787582964.985128:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 58 00000100:00100000:0.0:1787582964.985140:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+17:14537:x1874416162174336:12345-192.168.206.20@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787582965.011916:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934619 is committed 00000001:00080000:1.0:1787582965.011933:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000004:00080000:1.0:1787582965.011937:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787582965.011958:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000100:00100000:1.0:1787582965.012162:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb2b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186272768:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787582965.012228:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582965.012345:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186272768 00000100:00100000:3.0:1787582965.012352:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186272768 00000100:00100000:3.0:1787582965.012410:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787582965.012420:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874416186272768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787582965.012685:0:15013:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787582965.012701:0:15013:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787582965.012703:0:15013:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787582965.012705:0:15013:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787582965 -> 1787582965 00002000:00010000:3.0:1787582965.012707:0:15013:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787582965.013060:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874416186272768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 639us (830us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787582965.013068:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1787582965.013090:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787582965.013165:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8da5bb2b1f80/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787582965.013172:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb2b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874416186272768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787582965.013392:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+13:14537:x1874416162174336:12345-192.168.206.20@tcp:44:lhsmtool_posix.0 Request processed in 28252us (28775us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582965.013402:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 58 00000100:00100000:0.0:1787582965.016352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582965.016429:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162174464 00000100:00100000:3.0:1787582965.016438:0:15014:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162174464 00000100:00100000:3.0:1787582965.016649:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:3.0:1787582965.016660:0:15014:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+7:2360:x1874416162174464:12345-192.168.206.20@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787582965.016837:0:15014:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+7:2360:x1874416162174464:12345-192.168.206.20@tcp:16:lhsmtool_posix.0 Request processed in 178us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.016845:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:1.0:1787582965.020122:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582965.020228:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162174720 00000100:00100000:2.0:1787582965.020238:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162174720 00000100:00100000:2.0:1787582965.020441:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 59 00000100:00100000:2.0:1787582965.020452:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+13:14537:x1874416162174720:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787582965.020509:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582965.020704:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1e00/0xa113d808b7539312 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d5850b expref: 13 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582965.020722:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8da5a4492d00) 00010000:00010000:2.0:1787582965.020725:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787582965.020818:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7539320 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582965.020831:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7539320 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582965.020840:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7539320 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787582965.021024:0:14330:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bec6deeb reply state 00000000ae2a30b8 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7539320 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582965.021033:0:14330:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787582965.021122:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+14:14537:x1874416162174720:12345-192.168.206.20@tcp:36:lhsmtool_posix.0 Request processed in 672us (1008us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1787582965.021130:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 59 00000100:00100000:1.0:1787582965.024188:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582965.024852:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162174848 00000100:00100000:3.0:1787582965.024863:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162174848 00000100:00100000:3.0:1787582965.024909:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 17 00000100:00100000:3.0:1787582965.024918:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+7:14537:x1874416162174848:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787582965.024934:0:15013:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582965.024951:0:15013:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b7539327 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58519 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582965.024979:0:15013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012302236/0xa113d808b7539319 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58512 expref: 8 pid: 15014 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582965.024988:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787582965.025000:0:15013:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582965.025006:0:15013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b7539327 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58519 expref: 8 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582965.025040:0:15013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012302236/0xa113d808b7539319 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58512 expref: 8 pid: 15014 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582965.025054:0:15013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012302236/0xa113d808b7539319 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58512 expref: 8 pid: 15014 timeout: 606 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582965.025069:0:15013:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bb2b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15013:1874416186272896:192.168.206.20@tcp:104: 00000100:00100000:3.0:1787582965.025135:0:15013:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da582a86cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1787582965.025208:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7539320 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.025217:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7539320 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.025223:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7539320 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.025229:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d9fc00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582965.025233:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7539320 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.025240:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7539320 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.025264:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8da5a4492d00) 00010000:00010000:0.0:1787582965.025267:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582965.025271:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7539320 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.025287:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9fc00/0xa113d808b7539320 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582965.029594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582965.029978:0:15013:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bb2b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15013:1874416186272896:192.168.206.20@tcp:104: 00010000:00010000:3.0:1787582965.030012:0:15013:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b7539327 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58519 expref: 8 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582965.030032:0:15013:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0800, rc 0) 00000100:00100000:3.0:1787582965.030093:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+8:14537:x1874416162174848:12345-192.168.206.20@tcp:101:lhsmtool_posix.0 Request processed in 5175us (5915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.030101:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 17 00000100:00100000:1.0:1787582965.030188:0:14316:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162174976 00000100:00100000:1.0:1787582965.030195:0:14316:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162174976 00010000:00010000:1.0:1787582965.030224:0:14316:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012302236/0xa113d808b7539319 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58512 expref: 8 pid: 15014 timeout: 606 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582965.030256:0:14316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:1.0:1787582965.030264:0:14316:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+8:2360:x1874416162174976:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787582965.030277:0:14316:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787582965.030310:0:14316:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012302236/0xa113d808b7539319 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58512 expref: 8 pid: 15014 timeout: 606 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.030348:0:14316:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012302236/0xa113d808b7539319 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58512 expref: 8 pid: 15014 timeout: 606 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.030371:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012302236/0xa113d808b7539319 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58512 expref: 8 pid: 15014 timeout: 606 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.030383:0:14316:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582965.030387:0:14316:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787582965.030392:0:14316:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b7539327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58519 expref: 7 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.030401:0:14316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b7539327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58519 expref: 7 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.030433:0:14316:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b7539327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58519 expref: 7 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582965.030446:0:14316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5bbaa4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14316:1874416186273024:192.168.206.20@tcp:105: 00000100:00100000:1.0:1787582965.030506:0:14316:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a03e4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787582965.035414:0:14316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5bbaa4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14316:1874416186273024:192.168.206.20@tcp:105: 00010000:00010000:3.0:1787582965.035439:0:14316:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582965.035777:0:14316:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+7:2360:x1874416162174976:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 5511us (6189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.035788:0:14316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:1.0:1787582965.036887:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582965.036989:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162175104 00000100:00100000:0.0:1787582965.036999:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162175104 00000100:00100000:0.0:1787582965.037045:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 18 00000100:00100000:0.0:1787582965.037054:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+7:2360:x1874416162175104:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787582965.037235:0:15012:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787582965.037239:0:15012:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787582965 00002000:00010000:0.0:1787582965.037242:0:15012:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787582963 00002000:00010000:0.0:1787582965.037244:0:15012:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787582965 -> 1787582965 00002000:00010000:0.0:1787582965.037246:0:15012:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787582965.037296:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+8:2360:x1874416162175104:12345-192.168.206.20@tcp:2:lhsmtool_posix.0 Request processed in 242us (549us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787582965.037304:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 18 00000100:00100000:1.0:1787582965.041850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582965.041939:0:16556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162175232 00000100:00100000:0.0:1787582965.041949:0:16556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162175232 00000100:00100000:0.0:1787582965.041995:0:16556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 19 00000100:00100000:0.0:1787582965.042004:0:16556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bbaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad19012f-cc5a-4f9c-a000-5ca876cf3856+8:2360:x1874416162175232:12345-192.168.206.20@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787582965.042040:0:16556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d7a2bb6b/0xa113d808b753932e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.042060:0:16556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b7539327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58519 expref: 8 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.042084:0:16556:0:(ldlm_extent.c:415:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787582965.042088:0:16556:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787582965.042092:0:16556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a2bb6b/0xa113d808b753932e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.042123:0:16556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b7539327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58519 expref: 8 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.042138:0:16556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b7539327 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58519 expref: 8 pid: 15013 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582965.042152:0:16556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16556:1874416186273152:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582965.042313:0:16556:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a0640240 going to sleep for 11 seconds 00000100:00100000:1.0:1787582965.046521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582965.046587:0:16444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162175360 00000100:00100000:2.0:1787582965.046605:0:16444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162175360 00010000:00010000:2.0:1787582965.046638:0:16444:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b7539327 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58519 expref: 9 pid: 15013 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787582965.046680:0:16444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 15 00000100:00100000:2.0:1787582965.046688:0:16444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad19012f-cc5a-4f9c-a000-5ca876cf3856+9:2359:x1874416162175360:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787582965.046700:0:16444:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787582965.046720:0:16444:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b7539327 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58519 expref: 9 pid: 15013 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582965.046733:0:16444:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b7539327 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58519 expref: 9 pid: 15013 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582965.046768:0:16444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787582965.046773:0:16444:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787582965.046778:0:16444:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7a2bb6b/0xa113d808b753932e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582965.046788:0:16444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a2bb6b/0xa113d808b753932e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582965.046807:0:16444:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787582965.046858:0:16444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad19012f-cc5a-4f9c-a000-5ca876cf3856+9:2359:x1874416162175360:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 170us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582965.046866:0:16444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 15 00010000:00010000:0.0:1787582965.048633:0:16556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000483713cb/0xa113d808b7539327 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58519 expref: 8 pid: 15013 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582965.048656:0:16556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16556:1874416186273152:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582965.048679:0:16556:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7a2bb6b/0xa113d808b753932e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.048691:0:16556:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7a2bb6b/0xa113d808b753932e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.048717:0:16556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7a2bb6b/0xa113d808b753932e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.048747:0:16556:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d7a2bb6b/0xa113d808b753932e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.048822:0:16556:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7a2bb6b/0xa113d808b753932e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.048829:0:16556:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7a2bb6b/0xa113d808b753932e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.048835:0:16556:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e800 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582965.048839:0:16556:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a2bb6b/0xa113d808b753932e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.048849:0:16556:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7a2bb6b/0xa113d808b753932e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.048866:0:16556:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7a2bb6b/0xa113d808b753932e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.048873:0:16556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7a2bb6b/0xa113d808b753932e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582965.049007:0:16556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bbaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad19012f-cc5a-4f9c-a000-5ca876cf3856+7:2360:x1874416162175232:12345-192.168.206.20@tcp:1:lhsmtool_posix.0 Request processed in 7002us (7164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582965.049016:0:16556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 19 00000100:00100000:1.0:1787582965.052503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582965.052867:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162175616 00000100:00100000:0.0:1787582965.052877:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162175616 00000100:00100000:0.0:1787582965.052933:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 60 00000100:00100000:0.0:1787582965.052942:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+13:14537:x1874416162175616:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787582965.053020:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539335 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.053036:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539335 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.053048:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539335 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.053391:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753933c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.053402:0:14331:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7539304 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58504 expref: 14 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.053411:0:14331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753933c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.053448:0:14331:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7539304 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58504 expref: 14 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.053475:0:14331:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7539304 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58504 expref: 14 pid: 14329 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582965.053903:0:14331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14331:1874416186273280:192.168.206.20@tcp:104: 00000100:00100000:0.0:1787582965.054024:0:14331:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da5a0640240 going to sleep for 11 seconds 00000100:00100000:2.0:1787582965.057855:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582965.058396:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162175744 00000100:00100000:3.0:1787582965.058407:0:14315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162175744 00010000:00010000:3.0:1787582965.058447:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7539304 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58504 expref: 15 pid: 14329 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582965.058907:0:14331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14331:1874416186273280:192.168.206.20@tcp:104: 00010000:00010000:0.0:1787582965.058931:0:14331:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753933c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787582965.058985:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 16 00000100:00100000:3.0:1787582965.058995:0:14315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+15:2360:x1874416162175744:12345-192.168.206.20@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787582965.059011:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787582965.059018:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7539304 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58504 expref: 15 pid: 14329 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582965.059030:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7539304 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58504 expref: 15 pid: 14329 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582965.059050:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d0200/0xa113d808b7539304 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58504 expref: 15 pid: 14329 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582965.059065:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8da5a4492d00) 00010000:00010000:3.0:1787582965.059070:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753933c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582965.059078:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753933c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582965.059086:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753933c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582965.059113:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787582965.059167:0:14315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+14:2360:x1874416162175744:12345-192.168.206.20@tcp:103:ldlm_bl.0 Request processed in 173us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.059186:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 16 00010000:00010000:0.0:1787582965.059230:0:14331:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753933c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.059237:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753933c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787582965.059447:0:14331:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1787582965.059614:0:14331:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1787582965.059664:0:14331:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1787582965.059741:0:14331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14331:1874416186273408:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787582965.060105:0:14331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582965.060170:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186273408 00000100:00100000:0.0:1787582965.060176:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186273408 00000100:00100000:0.0:1787582965.060206:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787582965.060213:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14331:x1874416186273408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787582965.060282:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14331:x1874416186273408:12345-0@lo:1000:mdt00_002.0 Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582965.060297:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787582965.060350:0:14331:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58318e900 going to sleep for 11 seconds 00000100:00100000:0.0:1787582965.060372:0:14331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14331:1874416186273408:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787582965.061282:0:14331:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1787582965.061384:0:14331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14331:1874416186273536:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787582965.061423:0:14331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582965.061456:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186273536 00000100:00100000:0.0:1787582965.061461:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186273536 00000100:00100000:0.0:1787582965.061504:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787582965.063187:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14331:x1874416186273536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787582965.063923:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14331:x1874416186273536:12345-0@lo:1000:mdt00_002.0 Request processed in 2409us (2497us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787582965.063934:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787582965.063970:0:14331:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58318eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787582965.064000:0:14331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14331:1874416186273536:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787582965.064037:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753933c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.064047:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753933c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.064055:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753933c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.064061:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582965.064065:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753933c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.064085:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753933c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.064101:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8da5a4492d00) 00010000:00010000:0.0:1787582965.064104:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787582965.064108:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753933c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.064114:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753933c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.064144:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7539294 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.064150:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7539294 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.064156:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7539294 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.064161:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5a08d1c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582965.064164:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7539294 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.064170:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7539294 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.064178:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da583acc500) 00010000:00010000:0.0:1787582965.064180:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787582965.064186:0:14331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87000/0xa113d808b753929b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584e8 expref: 17 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.064208:0:14331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87000/0xa113d808b753929b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584e8 expref: 17 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.064216:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87000/0xa113d808b753929b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584e8 expref: 17 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.064740:0:14331:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d87000/0xa113d808b753929b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d584e8 expref: 17 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582965.064824:0:14331:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da5855c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14331:1874416186273664:192.168.206.20@tcp:105: 00000100:00100000:0.0:1787582965.064933:0:14331:0:(client.c:2715:ptlrpc_set_wait()) set ffff8da58318ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1787582965.069173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582965.069268:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162175872 00000100:00100000:3.0:1787582965.069277:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162175872 00000100:00100000:3.0:1787582965.069366:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:3.0:1787582965.069377:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+18:14536:x1874416162175872:12345-192.168.206.20@tcp:49:bash.0 00000100:00100000:3.0:1787582965.070166:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+18:14536:x1874416162175872:12345-192.168.206.20@tcp:49:bash.0 Request processed in 787us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.070175:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 12 00000100:00100000:0.0:1787582965.071916:0:14331:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da5855c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14331:1874416186273664:192.168.206.20@tcp:105: 00010000:00010000:0.0:1787582965.071946:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7539294 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.071956:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5a08d1c00/0xa113d808b7539294 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.071991:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539343 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072005:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539343 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072016:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539343 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072027:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539343 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072046:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539343 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072052:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539343 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072057:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582965.072061:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539343 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072067:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539343 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072078:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da583acc500) 00010000:00010000:0.0:1787582965.072081:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787582965.072084:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539343 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072089:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539343 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072099:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539335 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072104:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539335 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072109:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539335 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072113:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147ec00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787582965.072120:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539335 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072125:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539335 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072132:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da583acc500) 00010000:00010000:0.0:1787582965.072134:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787582965.072136:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539335 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.072141:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147ec00/0xa113d808b7539335 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787582965.072383:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+17:14537:x1874416162175616:12345-192.168.206.20@tcp:57:lhsmtool_posix.0 Request processed in 19441us (19898us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1787582965.072394:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 60 00000020:00080000:0.0:1787582965.072399:0:14331:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787582965.074243:0:14362:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787582965.074250:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787582965.074310:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787582965.074333:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787582965.074497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582965.075300:0:15012:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162176000 00000100:00100000:3.0:1787582965.075310:0:15012:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162176000 00000100:00100000:3.0:1787582965.075385:0:15012:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:3.0:1787582965.075394:0:15012:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+7:14536:x1874416162176000:12345-192.168.206.20@tcp:101:bash.0 00010000:00010000:3.0:1787582965.075409:0:15012:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787582965.075428:0:15012:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f107d381/0xa113d808b753934a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58520 expref: -99 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787582965.075452:0:15012:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8c59f5, atime: 0x6a8c59f3, ctime: 0x6a8c59f5, blocks: 0x1 00010000:00010000:3.0:1787582965.075471:0:15012:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=506s v=(0 0) 00010000:00010000:3.0:1787582965.075476:0:15012:0:(ldlm_extent.c:415:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787582965.075494:0:15012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f107d381/0xa113d808b753934a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58520 expref: 8 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582965.075655:0:15012:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f107d381/0xa113d808b753934a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58520 expref: 8 pid: 15012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787582965.075667:0:15012:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5a08d0c00, rc 0) 00000100:00100000:3.0:1787582965.075725:0:15012:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+8:14536:x1874416162176000:12345-192.168.206.20@tcp:101:bash.0 Request processed in 332us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.075732:0:15012:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:1.0:1787582965.080182:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:1.0:1787582965.080217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582965.080665:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162176384 00000100:00100000:0.0:1787582965.080675:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162176384 00000100:00100000:0.0:1787582965.080708:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162176512 00000100:00100000:0.0:1787582965.080710:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162176512 00000100:00100000:0.0:1787582965.080722:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 13 00000100:00100000:0.0:1787582965.080729:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+18:14536:x1874416162176384:12345-192.168.206.20@tcp:35:bash.0 00000001:00080000:0.0:1787582965.081108:0:14333:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:0.0:1787582965.081207:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+20:14536:x1874416162176384:12345-192.168.206.20@tcp:35:bash.0 Request processed in 477us (1032us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1787582965.081216:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 13 00000020:00080000:0.0:1787582965.081220:0:14333:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787582965.081233:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 14 00000100:00100000:0.0:1787582965.081247:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da482a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+19:14537:x1874416162176512:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787582965.086228:0:14333:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787582965.086365:0:14333:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00010000:00010000:1.0:1787582965.086436:0:14333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539351 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.086453:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539351 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.086466:0:14333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539351 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.086475:0:14333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539351 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.086482:0:14333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539351 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.086488:0:14333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539351 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.086572:0:14333:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787582965.086752:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da482a9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+21:14537:x1874416162176512:12345-192.168.206.20@tcp:35:lhsmtool_posix.0 Request processed in 5501us (6530us total) trans 8589934632 rc 0/0 00000100:00100000:1.0:1787582965.086767:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 14 00000020:00080000:1.0:1787582965.086774:0:14333:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787582965.087816:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787582965.087827:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539351 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.087836:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d86a00 already unused, calling callback (ffffffffc17a7230) 00010000:00010000:0.0:1787582965.087840:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539351 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.087848:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539351 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.087865:0:14317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8da5a4492d00) 00010000:00010000:0.0:1787582965.087868:0:14317:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787582965.087872:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539351 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.087878:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539351 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14333 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.087890:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582965.087892:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787582965.087894:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787582965.217264:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582965.217371:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162176768 00000100:00100000:2.0:1787582965.217382:0:14330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162176768 00000100:00100000:2.0:1787582965.217438:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 61 00000100:00100000:2.0:1787582965.217448:0:14330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+21:14547:x1874416162176768:12345-192.168.206.20@tcp:101:lfs.0 00010000:00010000:2.0:1787582965.217474:0:14330:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787582965.217492:0:14330:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7539358 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5c53be4782d58527 expref: -99 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787582965.217731:0:14330:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787582965.217881:0:14330:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7539358 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58527 expref: 23 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582965.217895:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8da5a4b29100) 00010000:00010000:2.0:1787582965.217898:0:14330:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787582965.217903:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d9e200/0xa113d808b7539358 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.20@tcp remote: 0x5c53be4782d58527 expref: 23 pid: 14330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787582965.217915:0:14330:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8da5b4d9e200, rc 0) 00000100:00100000:2.0:1787582965.217977:0:14330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ad19012f-cc5a-4f9c-a000-5ca876cf3856+22:14547:x1874416162176768:12345-192.168.206.20@tcp:101:lfs.0 Request processed in 530us (723us total) trans 8589934633 rc 301/301 00000100:00100000:2.0:1787582965.217984:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 61 00000100:00100000:2.0:1787582965.221058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:0.0:1787582965.222035:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162176896 00000100:00100000:0.0:1787582965.222046:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162176896 00000100:00100000:0.0:1787582965.222122:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 62 00000100:00100000:0.0:1787582965.222132:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+22:14547:x1874416162176896:12345-192.168.206.20@tcp:34:lfs.0 00010000:00010000:0.0:1787582965.222204:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539366 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.222247:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539366 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.222257:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539366 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.222272:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753936d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.222278:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753936d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787582965.222284:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753936d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232387:0:14331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539374 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232419:0:14331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539374 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232431:0:14331:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539374 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787582965.232615:0:14331:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539374 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232628:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539366 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232635:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539366 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232641:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539366 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232646:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582965.232651:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539366 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232658:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539366 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232670:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8da5a4b29000) 00010000:00010000:1.0:1787582965.232673:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582965.232677:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539366 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232682:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e800/0xa113d808b7539366 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232706:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753936d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232712:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753936d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232716:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753936d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232721:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da58147e400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582965.232724:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753936d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232729:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753936d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232737:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8da5a0b68900) 00010000:00010000:1.0:1787582965.232739:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582965.232742:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753936d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232746:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da58147e400/0xa113d808b753936d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232760:0:14331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539374 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232765:0:14331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539374 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232771:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539374 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232780:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8da5b4d86a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787582965.232783:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539374 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232789:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539374 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232798:0:14331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8da583acc500) 00010000:00010000:1.0:1787582965.232800:0:14331:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787582965.232802:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539374 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787582965.232807:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8da5b4d86a00/0xa113d808b7539374 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14331 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787582965.232894:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+22:14547:x1874416162176896:12345-192.168.206.20@tcp:34:lfs.0 Request processed in 10759us (11839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787582965.232903:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 62 00000100:00100000:0.0:1787582965.235396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:3.0:1787582965.235476:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162177152 00000100:00100000:3.0:1787582965.235485:0:14332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162177152 00000100:00100000:3.0:1787582965.235545:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 15 00000100:00100000:3.0:1787582965.235555:0:14332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+22:14547:x1874416162177152:12345-192.168.206.20@tcp:35:lfs.0 00000100:00100000:3.0:1787582965.236898:0:14332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ad19012f-cc5a-4f9c-a000-5ca876cf3856+23:14547:x1874416162177152:12345-192.168.206.20@tcp:35:lfs.0 Request processed in 1338us (1505us total) trans 8589934634 rc 0/0 00000100:00100000:3.0:1787582965.236910:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 15 00000100:00100000:1.0:1787582965.329202:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186273920:0@lo:400:kworker.0 00000100:00100000:2.0:1787582965.329239:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186274176:0@lo:400:kworker.0 00000100:00100000:1.0:1787582965.329277:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787582965.329284:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582965.329359:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3312:1874416186273792:0@lo:400:kworker.0 00000100:00100000:0.0:1787582965.329385:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186274048:0@lo:400:kworker.0 00000100:00100000:1.0:1787582965.329570:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186274432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582965.329695:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186274176 00000100:00100000:2.0:1787582965.329703:0:14329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186274176 00000100:00100000:2.0:1787582965.329750:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787582965.329758:0:14329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186274176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582965.329998:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787582965.330354:0:14331:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787582965.330363:0:14331:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787582965.330436:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186274048 00000100:00100000:0.0:1787582965.330441:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186274048 00000100:00100000:0.0:1787582965.330462:0:14331:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787582965.330469:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787582965.330476:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186274048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582965.330533:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874416186274048:12345-0@lo:400:kworker.0 Request processed in 57us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582965.330540:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787582965.330578:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874416186274048:0@lo:400:kworker.0 00000100:00100000:3.0:1787582965.330861:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582965.330894:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186274304:0@lo:400:kworker.0 00000100:00100000:3.0:1787582965.330968:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787582965.331003:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787582965.331086:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186273792 00000100:00100000:3.0:1787582965.331091:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186273792 00000100:00100000:3.0:1787582965.331213:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787582965.331267:0:16560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186274304 00000100:00100000:0.0:1787582965.331272:0:16560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186274304 00000100:00100000:3.0:1787582965.331295:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:3312:x1874416186273792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582965.331307:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787582965.331361:0:16560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5bb2b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186274304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787582965.331371:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3e2cf41e-7ffc-455b-9803-c6c5675ba817+19:3312:x1874416186273792:12345-0@lo:400:kworker.0 Request processed in 79us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582965.331387:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787582965.331417:0:16560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5bb2b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874416186274304:12345-0@lo:400:kworker.0 Request processed in 101us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582965.331425:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787582965.331488:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787582965.331529:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186273920 00000100:00100000:0.0:1787582965.331534:0:15013:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186273920 00000100:00080000:3.0:1787582965.331574:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787582965.331575:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787582965.331587:0:15013:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186273920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787582965.331628:0:15013:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186273920:12345-0@lo:400:kworker.0 Request processed in 44us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582965.331635:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787582965.332543:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787582965.332591:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186273920:0@lo:400:kworker.0 00000100:00100000:3.0:1787582965.332750:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:3e2cf41e-7ffc-455b-9803-c6c5675ba817:3312:1874416186273792:0@lo:400:kworker.0 00000100:00100000:3.0:1787582965.332999:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874416186274304:0@lo:400:kworker.0 00000100:00100000:0.0:1787582965.333683:0:15017:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186274432 00000100:00100000:0.0:1787582965.333691:0:15017:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186274432 00000100:00100000:0.0:1787582965.333748:0:15017:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787582965.333758:0:15017:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da481e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186274432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787582965.333796:0:15017:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787582965.333848:0:15017:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da481e6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874416186274432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787582965.333856:0:15017:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787582965.333995:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874416186274432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787582965.334098:0:14329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874416186274176:12345-0@lo:400:kworker.0 Request processed in 4339us (4814us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582965.334108:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787582965.334175:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874416186274176:0@lo:400:kworker.0 00010000:00010000:3.0:1787582965.456657:0:15403:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787582966.482450:0:14318:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787582966.765169:0:16597:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:0.0:1787582966.864513:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8da481e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186274560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787582966.864586:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787582966.864796:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416186274560 00000100:00100000:3.0:1787582966.864805:0:15016:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416186274560 00000100:00100000:3.0:1787582966.864859:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787582966.864870:0:15016:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5855c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874416186274560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787582966.864903:0:15016:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787582966.877011:0:15016:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5855c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874416186274560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12134us (12415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582966.877026:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787582966.877197:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8da481e6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874416186274560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787582967.252103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582967.252149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582967.252185:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582967.252220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582967.252239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582967.252262:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582967.252285:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.20@tcp (source: 12345-192.168.206.20@tcp) 00000100:00100000:2.0:1787582967.252313:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162177792 00000100:00100000:2.0:1787582967.252350:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162177792 00000100:00100000:2.0:1787582967.252405:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162177408 00000100:00100000:2.0:1787582967.252409:0:14331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162177408 00000100:00100000:2.0:1787582967.252433:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 29 00000100:00100000:2.0:1787582967.252443:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:2360:x1874416162177792:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582967.252539:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+6:2360:x1874416162177792:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 96us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582967.252547:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 29 00000100:00100000:2.0:1787582967.252564:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 30 00000100:00100000:2.0:1787582967.252571:0:14331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+23:2360:x1874416162177408:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582967.252597:0:14331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ad19012f-cc5a-4f9c-a000-5ca876cf3856+23:2360:x1874416162177408:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582967.252604:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 30 00000100:00100000:2.0:1787582967.252637:0:16556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162177536 00000100:00100000:2.0:1787582967.252641:0:16556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162177536 00000100:00100000:2.0:1787582967.252661:0:16556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162178048 00000100:00100000:2.0:1787582967.252664:0:16556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162178048 00000100:00100000:2.0:1787582967.252675:0:16556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162177664 00000100:00100000:2.0:1787582967.252678:0:16556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162177664 00000100:00100000:2.0:1787582967.252689:0:16556:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162177920 00000100:00100000:2.0:1787582967.252692:0:16556:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162177920 00000100:00100000:2.0:1787582967.252705:0:16556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 18 00000100:00100000:2.0:1787582967.252712:0:16556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad19012f-cc5a-4f9c-a000-5ca876cf3856+8:2360:x1874416162177536:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582967.252738:0:16556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad19012f-cc5a-4f9c-a000-5ca876cf3856+8:2360:x1874416162177536:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582967.252744:0:16556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 18 00000100:00100000:2.0:1787582967.252756:0:16556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 19 00000100:00100000:2.0:1787582967.252762:0:16556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+5:2360:x1874416162178048:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582967.252784:0:16556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+5:2360:x1874416162178048:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 22us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582967.252790:0:16556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 19 00000100:00100000:2.0:1787582967.252801:0:16556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:2.0:1787582967.252807:0:16556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad19012f-cc5a-4f9c-a000-5ca876cf3856+5:2360:x1874416162177664:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582967.252827:0:16556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ad19012f-cc5a-4f9c-a000-5ca876cf3856+5:2360:x1874416162177664:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 21us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582967.252833:0:16556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 20 00000100:00100000:2.0:1787582967.252844:0:16556:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 21 00000100:00100000:2.0:1787582967.252850:0:16556:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+5:2360:x1874416162177920:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:2.0:1787582967.252871:0:16556:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:64dc23e5-ef28-4ccf-8af3-ec936b4dede7+5:2360:x1874416162177920:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 21us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787582967.252883:0:16556:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 21 00000100:00100000:3.0:1787582967.253273:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874416162177280 00000100:00100000:3.0:1787582967.253279:0:14321:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874416162177280 00000100:00100000:3.0:1787582967.253345:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.20@tcp, seq: 122 00000100:00100000:3.0:1787582967.253353:0:14321:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8da5b4f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+13:2360:x1874416162177280:12345-192.168.206.20@tcp:400:kworker.0 00000100:00100000:3.0:1787582967.253389:0:14321:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8da5b4f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58cba94b-e776-4554-b8c0-88b86365e35e+13:2360:x1874416162177280:12345-192.168.206.20@tcp:400:kworker.0 Request processed in 37us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787582967.253398:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.20@tcp, seq: 122 00000100:00080000:3.0:1787582967.253424:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787582967.253427:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787582967.253430:0:14325:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787582967.505480:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787582967.962486:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:3.0:1787582967.962536:0:6733:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000040:00080000:1.0:1787582968.151094:0:14362:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787582968.151106:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787582968.151160:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787582968.151168:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 Debug log: 29888 lines, 29888 kept, 0 dropped, 0 bad.